-- Logs begin at Mon 2022-02-28 09:46:09 UTC, end at Mon 2022-02-28 10:49:23 UTC. -- Feb 28 10:22:49.250021 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 28 10:22:49.257347 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 10:22:49 2022] *** Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: nodename: dv-cinder-master-3-iscsi Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: machine: x86_64 Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: clock source: unix Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: pcre jit disabled Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: detected number of CPU cores: 4 Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: current working directory: / Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: detected binary path: /usr/bin/uwsgi-core Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: your processes number limit is 47680 Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: your memory page size is 4096 bytes Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: detected max file descriptor number: 2048 Feb 28 10:22:49.261034 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: lock engine: pthread robust mutexes Feb 28 10:22:49.261965 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: thunder lock: enabled Feb 28 10:22:49.261965 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 28 10:22:49.261965 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 10:22:49.305704 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: Python main interpreter initialized at 0x5598ba1c49c0 Feb 28 10:22:49.305704 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: python threads support enabled Feb 28 10:22:49.305704 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: your server socket listen backlog is limited to 100 connections Feb 28 10:22:49.305704 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: your mercy for graceful operations on workers is 90 seconds Feb 28 10:22:49.306059 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 10:22:49.306138 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: *** Operational MODE: preforking *** Feb 28 10:22:49.306366 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: *** uWSGI is running in multiple interpreter mode *** Feb 28 10:22:49.306366 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: spawned uWSGI master process (pid: 102067) Feb 28 10:22:49.306565 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 28 10:22:49.307666 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: spawned uWSGI worker 1 (pid: 102068, cores: 1) Feb 28 10:22:49.307666 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: spawned uWSGI worker 2 (pid: 102069, cores: 1) Feb 28 10:22:49.307666 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 10:22:51.157961 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:22:51.157961 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: from cryptography.utils import int_from_bytes Feb 28 10:22:51.158663 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:22:51.158663 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: from cryptography.utils import int_from_bytes Feb 28 10:22:51.181145 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:22:51.181145 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: from cryptography.utils import int_from_bytes Feb 28 10:22:51.181667 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:22:51.181667 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: from cryptography.utils import int_from_bytes Feb 28 10:22:53.732766 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 10:22:53.733340 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 10:22:53.733518 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 10:22:53.733630 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 10:22:53.733985 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 10:22:53.734077 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 10:22:53.734172 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 10:22:53.734381 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 10:22:53.734515 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.734777 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 10:22:53.734877 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.735040 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 10:22:53.735195 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.735433 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.735520 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.735762 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.735854 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.736087 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.736187 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.736413 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.736507 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.736751 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.736847 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.737068 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.737153 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.737342 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.737482 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.737669 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.737805 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.738000 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.738127 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.738277 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.738413 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.738619 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.738747 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.738953 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.739091 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.739283 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.739426 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.739594 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.739724 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.739912 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.740041 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.740220 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.740371 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.740530 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.740729 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.740882 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.742025 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.742236 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.742236 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.742560 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.742798 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.742998 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.743148 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.743364 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.743521 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.743733 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.743924 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.744080 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.744289 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.744485 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.744640 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.744853 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.745009 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.745185 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.745397 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.745553 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.745767 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.745960 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.746154 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.746346 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.746535 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.746706 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.746893 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.747691 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.747820 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.747982 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.748113 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.748236 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.748437 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.748576 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.748733 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.748858 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.748990 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.749113 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.749234 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.749379 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.749567 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.749693 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.749693 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.749940 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.750094 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.750226 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.750350 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.750484 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.750484 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.750743 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.750876 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.751005 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.751141 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.751273 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.751396 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.751519 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.751519 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.751755 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.751755 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.751993 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.752117 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.752245 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.752375 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.752504 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.752504 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.752812 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.752936 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.753058 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.753180 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.753302 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.753302 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.753562 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.753692 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.753816 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.753941 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.754072 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.754072 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.754312 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.754445 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.754578 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.754738 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.754878 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.755009 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.755131 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.755261 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.755383 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.755513 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.755642 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.755765 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.755888 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.756009 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.756143 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.756281 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.756404 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.756525 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.756653 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.756776 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.756903 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.757043 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.757166 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.757288 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.757411 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.757532 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.757660 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.757875 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.758001 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.758124 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.758279 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.758445 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.758583 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.758728 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.758863 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.759025 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.759152 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.759375 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.759516 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.759757 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.759922 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.760047 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.760169 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.760290 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.760424 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.760613 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.760748 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.760923 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.761049 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.761233 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.761368 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.761541 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.761668 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.761866 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.761999 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.762128 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.762262 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.762429 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.762590 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.762806 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.763060 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.763198 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.763374 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.763507 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.763687 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.763819 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.764014 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.764152 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.764320 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.764450 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.764627 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.764760 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.764937 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.765071 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.765242 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.765368 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.765551 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.765676 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.765859 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.765992 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.766166 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.766290 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.766473 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.766619 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.766808 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.766936 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.767115 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.767241 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.767425 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.767558 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.767736 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.767877 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.768068 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.768200 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.768323 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.768444 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.768634 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.768761 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.768946 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.769081 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.769254 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.769378 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.769567 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.769715 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.769900 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.770039 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.770185 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.770320 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.770491 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.770664 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.770824 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.770962 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.771146 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.771270 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.771471 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.771605 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.771749 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.771874 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.772072 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.772198 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.772376 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.772500 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.772683 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.772807 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.773003 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.773128 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.773307 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.773431 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.773615 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.773747 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.773920 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.774055 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.774228 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.774361 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.774536 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.774678 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.774868 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.775004 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.775177 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.775302 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.775480 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.775611 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.775783 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.775916 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.776086 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.776218 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.776394 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.776526 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.776696 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.776830 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.777013 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.777137 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.777325 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.777458 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.777632 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.777758 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.777941 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.778080 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.778347 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.778486 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.778752 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:22:53.778881 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.779085 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.779221 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.779427 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.779679 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.779815 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.780083 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.780218 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.780406 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.780622 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.780748 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.781048 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.781172 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.781367 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.781528 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.781685 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.781860 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.781987 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.782184 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.782310 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.782507 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.782670 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.782869 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.782996 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.783191 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.783328 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.783513 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.783639 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.783835 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.783985 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.784160 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.784287 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.784502 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.784630 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.784843 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.784977 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.785166 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.785298 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.785481 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.785606 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.785803 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.785929 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.786122 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.786249 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.786441 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.786568 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.786803 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.786931 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.787131 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.787263 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.787447 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.787580 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.787767 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.787894 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.788085 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.788205 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.788416 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.788551 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.788739 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.788896 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.789058 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.789185 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.789385 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.789520 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.789704 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.789831 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.790063 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.790198 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.790320 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.790455 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.790660 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.790798 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.790976 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.791115 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.791319 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.791447 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.791640 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.791767 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.791964 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.792099 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.792281 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.792409 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.792604 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.792730 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.792917 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.793043 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.793230 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.793356 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.793546 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.793673 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.794410 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.794542 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.794755 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.794884 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.795081 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.795212 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.795399 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.795602 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.795728 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.795857 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.796013 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.796140 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.796323 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.796458 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.796633 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.796760 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.796943 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.797076 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.797257 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.797392 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.797565 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.797693 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.797904 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.798082 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.798215 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.798338 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.798545 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.798694 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.798865 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.799083 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.799210 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.799347 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.799471 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.799593 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.799783 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.799909 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.800171 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.800307 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.800431 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.800567 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.800699 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.800823 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.801010 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.801145 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.801319 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.801448 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.801647 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.801774 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.801964 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.802132 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.802276 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.802401 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.802592 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.802746 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.802927 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.803053 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.803238 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.803365 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.803562 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.803700 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.803877 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.804002 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.804193 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.804320 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.804509 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.804645 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.804824 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.804959 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.805153 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.805280 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.805472 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.805609 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.805789 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.805916 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.806099 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.806231 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.806419 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.806720 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.806849 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.806972 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.807101 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.807224 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.807355 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.807478 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.807651 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.807778 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.807962 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.808088 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.808273 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.808400 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.808581 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.808711 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.808890 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.809016 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.809196 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.809321 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.809597 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.810352 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.810479 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.810634 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.810759 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.810894 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.811016 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.811139 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.811304 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.811439 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.811615 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.811748 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.811944 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.812069 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.812261 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.812399 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.812603 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.812736 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.812859 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.812982 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.813208 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.813343 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.813557 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.813682 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.813882 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.814114 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.814253 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.814506 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.814675 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.814851 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.815114 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.815241 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.815489 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.815614 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.815806 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.815994 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.816121 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.816416 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.816550 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.816774 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.816910 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.817040 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.817163 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.817363 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.817585 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.817712 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.817986 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.818115 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.818332 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.818482 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.818697 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.818964 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.819091 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.819335 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.819461 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.819653 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.819842 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.819968 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.820168 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.820296 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.820578 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.820715 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.820894 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.821029 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.821210 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.821454 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.821581 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.821834 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.821966 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.822157 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.822365 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.822492 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.822813 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.822953 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.823129 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.823337 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.823465 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.823670 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.823797 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.824006 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.824126 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.824331 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.824466 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.824658 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.824802 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.824979 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.825134 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.825665 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.825793 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.825916 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.826048 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.826179 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.826302 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.826424 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.826547 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.826694 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.826910 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.827105 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.827231 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.827362 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.827492 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.827617 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.827748 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.827879 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.828009 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.828140 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.828270 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.828401 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.828525 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.828711 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.828846 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.829048 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.829174 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.829387 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.829513 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.829697 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.829822 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.830009 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.830138 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.830325 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.830458 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.830683 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.830821 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.830970 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.831103 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.831287 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.831414 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.831597 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.831725 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.832159 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.832296 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.832469 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.832601 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.832788 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.832913 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.833101 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.833238 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.833413 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.833538 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.833797 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.833950 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.834082 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.834202 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.834331 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.834454 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.834666 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.834808 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.834957 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.835093 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.835271 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.835397 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.835598 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.835731 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.835913 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.836040 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.836233 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.836366 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.836550 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.836677 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.836857 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.836983 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.837193 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.837333 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.837488 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.837615 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.837802 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.837949 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.838109 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.838234 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.838418 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.838543 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.838749 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.838877 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.839062 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.839195 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.839392 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.839527 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.839698 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.839823 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.840012 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.840144 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.840326 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.840461 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.840700 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.840842 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.840969 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.841097 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.841277 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.841495 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.841629 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.841901 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.842080 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.842225 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.842424 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.842547 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.842779 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.842894 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.843112 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.843234 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.843443 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.843557 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.843753 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.843943 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.844067 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.844174 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.844386 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.844501 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.844701 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.844813 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.845013 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.845125 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.845322 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.845458 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.845636 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.845749 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.845958 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.846076 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.846290 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.846529 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.846663 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.846896 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.847009 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.847217 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.847410 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.847541 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.847648 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.847837 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.847957 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.848151 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.848264 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.848466 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.848580 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.848806 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.848936 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.849104 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.849225 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.849418 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.849537 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.849736 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.849857 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.850049 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.850167 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.850357 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.850469 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.850693 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.850826 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.851007 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.851120 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.851305 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.851432 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.852142 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.852270 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.852394 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.852527 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.852659 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.852784 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.852907 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.853032 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.853156 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.853288 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.853411 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.853541 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.853664 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.853786 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.853939 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.854131 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.854258 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.854380 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.854502 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.854667 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.854805 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.854931 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.855063 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.855186 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.855309 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.855431 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.855561 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.855712 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.855839 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.856028 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.856154 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.856881 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.857028 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.857204 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.857330 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.857544 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.857701 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.857837 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.858053 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.858208 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.858367 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.858495 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.858703 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.858866 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.859031 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.859159 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.859345 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.859470 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.859656 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.859792 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.859966 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.860091 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.860282 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.860415 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.860597 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.860730 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.860906 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.861030 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.861220 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.861352 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.861532 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.861659 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.861846 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.861971 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.862157 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.862291 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.862465 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.862590 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.862811 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.862937 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.863129 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.863256 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.863447 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.863581 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.863759 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.863891 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.864065 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.864271 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.864408 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.864532 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.864661 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.864791 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.864979 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.865114 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.865286 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.865414 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.865600 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.865733 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.865907 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.866063 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.866221 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.866346 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.866528 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.866672 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.866866 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.867004 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.867176 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.867301 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.867491 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.867693 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.867820 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.867950 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.868095 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.868227 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.868406 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.868533 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.868721 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.868846 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.869028 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.869151 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.869336 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.869460 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.869646 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.869772 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.869951 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.870082 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.870260 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.870391 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.870571 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.870770 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.870914 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.871039 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.871226 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.871352 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.871532 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.871660 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.871836 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.872006 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.872766 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.872905 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.873174 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.873305 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.873436 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.873560 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.873736 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.873872 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.874048 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.874175 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.874383 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.874510 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.874676 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.874819 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.874993 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.875130 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.875301 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.875435 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.875627 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.875764 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.875941 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.876067 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.876247 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.876380 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.876554 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.876694 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.876859 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.876986 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.877177 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.877302 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.877500 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.877625 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.877826 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.877963 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.878120 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.878247 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.878451 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.878738 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.878861 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.878996 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.879120 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.879249 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.879408 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.879535 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.879728 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.879854 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.880035 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.880162 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.880350 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.880483 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.880663 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.880788 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.880976 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.881181 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.881314 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.881436 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.881579 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.881706 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.881899 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.882032 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.882210 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.882334 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.882524 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.882703 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.882866 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.883006 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.883185 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.883312 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.883503 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.883630 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.883810 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.883944 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.884124 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.884252 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.884455 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.884589 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.884725 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.884847 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.885043 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.885177 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.885354 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.885481 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.885665 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.885790 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.885975 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.886103 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.886286 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.886419 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.886618 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.886746 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.886936 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.887062 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.887247 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.887375 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.887660 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.887791 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.887993 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.888189 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.888454 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.888591 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.888792 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.888946 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.889109 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.889244 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.889423 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.889556 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.889738 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.889864 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.890047 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.890172 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.890360 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.890495 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.890697 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.890824 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.891077 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.891202 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.891398 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.891533 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.891732 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.891858 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.892041 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.892172 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.892350 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.892475 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.892662 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.892795 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.892978 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.893102 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.893288 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.893412 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.893594 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.893719 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.894017 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.894143 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.894334 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.894459 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.894680 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.894806 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.894983 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.895111 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.895294 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.895428 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.895604 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.895736 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.895919 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.896059 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.896249 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.896376 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.896558 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.896684 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.896868 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.897007 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.897177 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.897304 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.897505 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.897631 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.897815 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.897955 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.898188 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.898327 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.898484 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.898642 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.898831 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.898973 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.899144 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.899271 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.899474 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.899676 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.899810 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.899934 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.900114 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.900250 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.900446 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.900573 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.900810 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.900935 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.901142 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.901270 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.901452 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.901579 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.901772 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.901899 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.902099 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.902233 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.902405 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.902537 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.902737 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.902875 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.903058 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.903891 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.904027 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.904152 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.904318 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.904519 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.904672 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.904865 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.904992 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.905173 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.905301 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.905502 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.905629 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.905833 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.905966 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.906151 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.906277 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.906463 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.906590 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.906821 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.906947 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.907134 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.907267 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.907466 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.907594 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.907788 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.907913 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.908115 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.908316 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.908461 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.908584 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.908707 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.908830 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.909019 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.909155 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.909348 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.909469 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.909656 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.909783 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.909968 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.910108 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.910278 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.910405 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.910589 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.910742 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.910923 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.911059 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.911232 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.911359 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.911558 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.911685 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.911868 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.912003 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.912195 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.912322 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.912515 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.912643 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.912842 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.912970 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.913170 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.913296 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.913508 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.913643 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.913802 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.913929 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.914112 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.914237 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.914418 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.914551 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.914747 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.914893 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.915082 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.915218 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.915342 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.915464 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.915647 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.915776 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.915970 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.916096 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.916281 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.916416 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.916592 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.916752 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.916902 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.917028 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.917234 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.917370 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.917543 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.917671 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.917872 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.917999 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.918188 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.918336 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.918524 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.918668 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.918870 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.919500 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.919692 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.919837 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.920023 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.920150 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.920338 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.920469 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.920681 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.920809 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.921007 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.921134 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.921320 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.921452 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.921632 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.921760 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.921942 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.922071 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.922251 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.922385 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.922577 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.922738 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.922905 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.923033 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.923233 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.923370 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.923544 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.923669 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.923850 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.923986 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.924157 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.924294 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.924464 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.924591 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.924778 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.924911 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.925127 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.925273 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.925405 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.925536 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.925730 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.925857 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.926059 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.926280 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.926408 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.926632 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.926762 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.926960 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.927086 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.927282 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.927417 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.927602 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.927730 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.927924 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.928063 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.928244 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.928371 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.928573 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.928705 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.928870 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.929004 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.929183 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.929310 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.929493 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.929625 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.929812 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.929946 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.930132 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.930259 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.930452 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.930579 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.930830 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.931005 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.931155 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.931339 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.931468 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.931659 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.931796 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.931978 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.932112 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.932294 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.932443 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.932706 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.932841 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.932964 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.933087 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.933210 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.933374 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.933515 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.933698 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.933825 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.934022 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.934156 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.934340 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.934502 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.934760 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.935028 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.935174 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.935372 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.935500 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.935634 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.935758 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.935881 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.936010 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.936134 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.936266 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.936390 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.936571 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.936699 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.936903 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.937029 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.937247 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.937374 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.937575 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.937702 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.937896 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.938030 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.938216 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.938340 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.938538 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.938749 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.938876 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.939090 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.939246 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.939414 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.939540 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.939757 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.939891 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.940089 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.940220 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.940405 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.940538 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.940723 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.940864 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.941040 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.941166 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.941369 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.941497 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.941682 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.941815 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.941996 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.942123 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.942314 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.942446 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.942647 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.942788 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.942963 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.943088 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.943294 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.943483 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.943609 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.943803 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.943930 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.944142 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.944269 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.944475 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.944610 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.944803 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.945064 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.945191 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.945427 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.945565 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.945754 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.945883 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.946072 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.946198 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.946384 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.946511 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.946830 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.946975 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.947102 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.947239 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.947364 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.947498 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.947632 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.947757 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.947936 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.948064 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.948246 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.948381 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.948569 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.948696 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.948898 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.949025 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.949201 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.949405 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.949533 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.949758 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.949878 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.950154 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.950420 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.950557 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.950723 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.950865 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.950990 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.951114 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.951236 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.951421 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.951558 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.951736 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.951864 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.952051 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.952186 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.952368 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.952495 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.952679 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.952806 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.952991 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.953134 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.953303 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.953431 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.953614 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.953741 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.953935 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.954133 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.954264 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.954389 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.954552 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.954714 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.954891 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.955026 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.955200 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.955326 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.955532 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.955666 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.955803 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.955936 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.956125 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.956250 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.956430 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.956565 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.956748 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.957124 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.957316 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.957444 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.957626 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.957766 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.957937 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.958065 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.958246 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.958377 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.958560 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.958749 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.958898 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.959087 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.959224 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.959363 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.959488 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.959619 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.959799 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.960077 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.960204 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.960410 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.960536 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.960736 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.960880 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.961078 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.961202 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.961388 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.961522 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.961720 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.961847 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.962004 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.962131 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.962314 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.962447 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.962659 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.962786 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.962981 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.963119 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.963296 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.963430 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.963616 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.963743 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.963932 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.964068 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.964249 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.964481 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.964608 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.964816 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.964950 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.965141 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.965267 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.965471 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.965610 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.966335 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.966466 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.966643 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.966783 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.966947 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.967108 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.967247 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.967434 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.967574 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.967786 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.967913 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.968116 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.968244 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.968443 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.968571 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.968769 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.968897 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.969131 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.969266 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.969390 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.969524 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.969697 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.969826 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.970011 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.970137 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.970323 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.970455 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.970657 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.970787 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.970973 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.971101 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.971287 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.971431 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.971598 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.971724 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.971942 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.972069 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.972267 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.972396 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.972588 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.972715 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.972910 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.973037 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.973231 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.973361 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.973546 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.973673 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.973859 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.973986 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.974173 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.974302 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.974488 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.974634 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.974831 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.974958 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.975165 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.975293 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.975483 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.975610 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.975790 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.975930 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.976152 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.976278 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.976491 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.976627 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.976774 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.976918 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.977088 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.977215 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.977407 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.977533 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.977734 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.977874 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.978051 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.978185 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.978364 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.978491 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.978702 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.978830 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.979017 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.979141 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.979341 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.979467 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.979622 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.979751 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.979933 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.980067 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.980243 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.980378 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.980558 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.980687 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.980867 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.980995 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.981177 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.981376 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.981551 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.981686 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.981979 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.982105 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.982321 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.982461 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.982657 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.982847 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.982988 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.983113 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.983276 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.983412 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.983582 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.983709 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.983888 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.984021 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.984196 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.984331 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.984503 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.984630 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.984816 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.984948 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.985124 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.985253 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.985434 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.985562 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.985742 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.985870 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.986050 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.986186 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.986362 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.986504 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.986744 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.986873 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.987008 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.987140 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.987286 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.987414 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.987593 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.987721 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.987900 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.988029 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.988208 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.988336 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.988515 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.988651 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.988850 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.988971 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.989186 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.989336 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.989533 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.989668 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.989793 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.989917 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.990108 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.990237 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.990429 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.990563 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.990755 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.990889 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.991080 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.991209 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.991404 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.991607 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.991741 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.991866 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.992021 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.992149 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.992347 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.992474 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.992659 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.992784 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.992975 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.993103 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.993292 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.993421 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.993607 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.993732 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.993918 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.994043 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.994233 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.994361 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.994553 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.994710 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.994901 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.995041 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.995209 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.995341 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.995539 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.995667 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.995860 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.995997 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.996185 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.996313 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.996510 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.996647 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.996848 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.997500 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.997798 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.997931 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.998199 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.998325 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.998481 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.998677 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.998831 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.998958 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.999154 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.999281 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.999470 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.999689 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:53.999817 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 10:22:53.999941 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.000100 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.000434 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.000768 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.001101 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.001434 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.001787 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.002104 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.002448 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.002804 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.003127 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.003443 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.003756 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:22:54.004005 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 10:22:54.022169 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:22:54.026190 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_db.sqlalchemy.engines [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:22:54.086630 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.context [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c755071f-4a59-4a8e-8ef6-dfe2026d3c30(cell1) {{(pid=102069) load_cells /opt/stack/nova/nova/context.py:464}} Feb 28 10:22:54.090024 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.context [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c755071f-4a59-4a8e-8ef6-dfe2026d3c30(cell1) {{(pid=102068) load_cells /opt/stack/nova/nova/context.py:464}} Feb 28 10:22:54.091405 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG oslo_concurrency.lockutils [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:22:54.093106 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG oslo_concurrency.lockutils [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:22:54.093925 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG oslo_concurrency.lockutils [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:22:54.094740 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:22:54.095920 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG oslo_concurrency.lockutils [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:22:54.096345 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:22:54.097166 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:22:54.099164 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:22:54.108617 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:22:54.112129 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:22:54.115553 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_db.sqlalchemy.engines [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:22:54.118984 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_db.sqlalchemy.engines [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:22:54.268523 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG oslo_db.sqlalchemy.engines [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:22:54.282259 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_db.sqlalchemy.engines [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:22:54.610238 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: WARNING keystonemiddleware.auth_token [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 10:22:54.615282 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: WARNING keystonemiddleware.auth_token [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 10:22:54.616893 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: WARNING keystonemiddleware.auth_token [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 10:22:54.621887 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: WARNING keystonemiddleware.auth_token [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 10:22:54.956825 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: WARNING keystonemiddleware.auth_token [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 10:22:54.961340 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: WARNING keystonemiddleware.auth_token [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 10:22:54.962212 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: WARNING keystonemiddleware.auth_token [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 10:22:54.967106 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: WARNING keystonemiddleware.auth_token [None req-aab32d32-3682-4233-aea5-d148683fc179 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 10:22:54.968251 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5598ba1c49c0 pid: 102069 (default app) Feb 28 10:22:54.970324 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:22:54.971514 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] 10.222.0.21 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001752 Feb 28 10:22:54.971913 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 788 bytes} [Mon Feb 28 10:22:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:22:54.972461 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5598ba1c49c0 pid: 102068 (default app) Feb 28 10:24:16.596079 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:16.597105 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Feb 28 10:24:16.597499 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 2/2] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:24:17.022842 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-9adb6a26-4127-4a67-8717-ea80a0eb8e36 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:17.053375 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-9adb6a26-4127-4a67-8717-ea80a0eb8e36 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.448869 Feb 28 10:24:17.054118 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 1/3] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Feb 28 10:24:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:19.424600 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:19.425608 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-f8d22833-28e3-4c42-86c9-fa5008a974fc None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Feb 28 10:24:19.426005 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 3/4] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:19.485476 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-c491bc4b-5ff2-4c19-9145-1eaeffe8bcc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:19.505031 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:24:19.505031 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: warnings.warn(msg) Feb 28 10:24:19.537851 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-c491bc4b-5ff2-4c19-9145-1eaeffe8bcc8 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105894 Feb 28 10:24:19.542649 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 2/5] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:24:19.759039 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-df124f46-c634-467c-8f19-d62686060763 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:19.762358 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:24:19.762358 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: warnings.warn(msg) Feb 28 10:24:19.810394 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-df124f46-c634-467c-8f19-d62686060763 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262599 Feb 28 10:24:19.822626 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 4/6] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 10:24:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:22.186352 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-c491bc4b-5ff2-4c19-9145-1eaeffe8bcc8 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:22.187408 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-c491bc4b-5ff2-4c19-9145-1eaeffe8bcc8 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Feb 28 10:24:22.187844 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 3/7] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:22.299770 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-17ff6032-985b-42a4-a4da-89474260bc8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "disk": 5}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:22.317704 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:24:22.317704 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: warnings.warn(msg) Feb 28 10:24:22.335513 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-17ff6032-985b-42a4-a4da-89474260bc8d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141905 Feb 28 10:24:22.336068 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 5/8] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 10:24:22.348516 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-2fdc3d68-5d4d-4504-86d6-8d69acb32396 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:22.350017 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:24:22.350017 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: warnings.warn(msg) Feb 28 10:24:22.393030 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-2fdc3d68-5d4d-4504-86d6-8d69acb32396 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047058 Feb 28 10:24:22.394742 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 4/9] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 10:24:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:24.820963 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-17ff6032-985b-42a4-a4da-89474260bc8d admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:24.822449 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-17ff6032-985b-42a4-a4da-89474260bc8d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Feb 28 10:24:24.822995 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 6/10] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:24.887986 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-2e42d42e-2b0a-4946-85fe-f06dc9de890e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:24.912001 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-2e42d42e-2b0a-4946-85fe-f06dc9de890e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082528 Feb 28 10:24:24.913288 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 5/11] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:24:24.927715 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-4a6d04bb-f58f-418d-8299-fcdcf70e1901 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:24.952856 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-4a6d04bb-f58f-418d-8299-fcdcf70e1901 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028972 Feb 28 10:24:24.958638 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 7/12] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 10:24:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:27.449104 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-2e42d42e-2b0a-4946-85fe-f06dc9de890e admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:27.450152 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-2e42d42e-2b0a-4946-85fe-f06dc9de890e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Feb 28 10:24:27.450555 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 6/13] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:27.511216 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-35771b32-d482-4ca5-9a0b-5526e5e64d17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:27.530154 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-35771b32-d482-4ca5-9a0b-5526e5e64d17 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073475 Feb 28 10:24:27.530734 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 8/14] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:24:27.542932 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-be440813-2f8f-4200-9177-de390f6968f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:27.566325 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-be440813-2f8f-4200-9177-de390f6968f1 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027642 Feb 28 10:24:27.567109 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 7/15] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 10:24:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:29.939487 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-35771b32-d482-4ca5-9a0b-5526e5e64d17 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:29.940494 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-35771b32-d482-4ca5-9a0b-5526e5e64d17 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Feb 28 10:24:29.940909 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 9/16] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:30.005569 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-6322c1b8-79e7-4c4f-b2fd-9e6f9eb1a12f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "disk": 20, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:30.023732 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-6322c1b8-79e7-4c4f-b2fd-9e6f9eb1a12f admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077229 Feb 28 10:24:30.024497 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 8/17] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 10:24:30.036868 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-3a3d478e-ff55-4b47-905a-98683b399d93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:30.060474 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-3a3d478e-ff55-4b47-905a-98683b399d93 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027397 Feb 28 10:24:30.061038 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 10/18] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 10:24:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:32.423164 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-6322c1b8-79e7-4c4f-b2fd-9e6f9eb1a12f admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:32.424182 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-6322c1b8-79e7-4c4f-b2fd-9e6f9eb1a12f admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Feb 28 10:24:32.424582 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 9/19] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:32.484498 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-c3ad2066-658f-4911-9a49-a5305cd03a5b admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:32.508273 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-c3ad2066-658f-4911-9a49-a5305cd03a5b admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077708 Feb 28 10:24:32.508930 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 11/20] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Feb 28 10:24:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:24:34.860283 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-6322c1b8-79e7-4c4f-b2fd-9e6f9eb1a12f admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:34.861301 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-6322c1b8-79e7-4c4f-b2fd-9e6f9eb1a12f admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Feb 28 10:24:34.861705 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 10/21] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:34.920043 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-ced699a8-0ad9-45a3-b3e8-9b578e4ee281 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "name": "m1.tiny", "vcpus": 1, "ram": 512}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:34.938052 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-ced699a8-0ad9-45a3-b3e8-9b578e4ee281 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070454 Feb 28 10:24:34.938643 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 12/22] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:24:34.952933 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-ffa6ebd3-792d-4c55-ae59-eabccb84f692 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:34.973935 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-ffa6ebd3-792d-4c55-ae59-eabccb84f692 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027389 Feb 28 10:24:34.974507 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 11/23] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 10:24:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:37.617249 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-ced699a8-0ad9-45a3-b3e8-9b578e4ee281 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:37.618957 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-ced699a8-0ad9-45a3-b3e8-9b578e4ee281 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Feb 28 10:24:37.619868 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:37.684162 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-3dce930d-842c-4677-97be-b85eaef74677 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:37.702066 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-3dce930d-842c-4677-97be-b85eaef74677 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076581 Feb 28 10:24:37.702627 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 12/25] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:24:37.714970 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-330024fb-69ea-4193-8af9-5708f95c597a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:37.737337 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-330024fb-69ea-4193-8af9-5708f95c597a admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026530 Feb 28 10:24:37.737915 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 14/26] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 10:24:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:40.252076 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-3dce930d-842c-4677-97be-b85eaef74677 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:40.253227 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-3dce930d-842c-4677-97be-b85eaef74677 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Feb 28 10:24:40.253774 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 13/27] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:40.315255 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-400189f8-bfb8-48b4-bcd0-784ffe59a1bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "name": "m1.medium"}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:40.334178 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-400189f8-bfb8-48b4-bcd0-784ffe59a1bd admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072862 Feb 28 10:24:40.334751 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 15/28] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:24:40.347753 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-6ec2aed4-3bf2-4f82-9ec6-7ab340366c76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:40.372195 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-6ec2aed4-3bf2-4f82-9ec6-7ab340366c76 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028220 Feb 28 10:24:40.372802 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 14/29] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 10:24:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:42.813066 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-400189f8-bfb8-48b4-bcd0-784ffe59a1bd admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:42.814034 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-400189f8-bfb8-48b4-bcd0-784ffe59a1bd admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Feb 28 10:24:42.814434 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 16/30] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:42.879786 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-08458444-2f16-4382-8b26-ce83d0b71ac2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "rxtx_factor": 1.0}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:42.898112 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-08458444-2f16-4382-8b26-ce83d0b71ac2 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077841 Feb 28 10:24:42.898693 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 15/31] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:24:42.911399 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-f1fa24aa-d2a2-4783-b8a0-2d9309045bdc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:42.942501 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-f1fa24aa-d2a2-4783-b8a0-2d9309045bdc admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033141 Feb 28 10:24:42.943863 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 17/32] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 10:24:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:24:45.405003 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-08458444-2f16-4382-8b26-ce83d0b71ac2 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:24:45.406111 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-08458444-2f16-4382-8b26-ce83d0b71ac2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Feb 28 10:24:45.406586 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 16/33] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:24:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:24:45.466065 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-d73cacc8-adca-4f77-9264-76d270c2f5a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "id": "5", "ram": 16384, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:45.485342 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-d73cacc8-adca-4f77-9264-76d270c2f5a3 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073066 Feb 28 10:24:45.485979 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 18/34] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 10:24:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 10:24:45.497946 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-cb301e21-c9a9-46a8-8b5e-49ea1d69ec90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:24:45.521226 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-cb301e21-c9a9-46a8-8b5e-49ea1d69ec90 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027217 Feb 28 10:24:45.521807 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 17/35] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 10:24:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:25:13.091501 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-d73cacc8-adca-4f77-9264-76d270c2f5a3 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:13.092504 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-d73cacc8-adca-4f77-9264-76d270c2f5a3 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Feb 28 10:25:13.092901 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 19/36] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:25:13.149475 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-1520569a-2c7a-41d6-88b0-b2e6955e6746 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:13.166228 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-1520569a-2c7a-41d6-88b0-b2e6955e6746 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067698 Feb 28 10:25:13.166786 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 18/37] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Feb 28 10:25:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:25:14.570686 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-d73cacc8-adca-4f77-9264-76d270c2f5a3 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:14.572177 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-d73cacc8-adca-4f77-9264-76d270c2f5a3 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002715 Feb 28 10:25:14.572802 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 20/38] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:25:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:25:14.767752 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-f8521e55-7d3b-499f-86c8-981e2333a40c admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:14.774154 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.wsgi [None req-f8521e55-7d3b-499f-86c8-981e2333a40c admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 28 10:25:14.774751 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-f8521e55-7d3b-499f-86c8-981e2333a40c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:25:14.775545 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-f8521e55-7d3b-499f-86c8-981e2333a40c admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057723 Feb 28 10:25:14.776054 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 19/39] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Feb 28 10:25:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 28 10:25:14.785364 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-08db8b1f-17e6-4e46-94eb-ea7a4f481f31 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:14.806422 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-08db8b1f-17e6-4e46-94eb-ea7a4f481f31 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024702 Feb 28 10:25:14.806975 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 21/40] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 10:25:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:25:14.816381 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-1a44f37d-e9b8-43b3-8239-4fc552300720 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:14.839040 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-1a44f37d-e9b8-43b3-8239-4fc552300720 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026115 Feb 28 10:25:14.839580 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 20/41] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 10:25:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:25:14.848827 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-736df2cf-b669-46fc-ae07-723d8bf374c0 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:14.854560 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.wsgi [None req-736df2cf-b669-46fc-ae07-723d8bf374c0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 28 10:25:14.855155 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-736df2cf-b669-46fc-ae07-723d8bf374c0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:25:14.855950 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-736df2cf-b669-46fc-ae07-723d8bf374c0 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010821 Feb 28 10:25:14.856449 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 22/42] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Feb 28 10:25:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 28 10:25:16.118885 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-1a44f37d-e9b8-43b3-8239-4fc552300720 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:16.119899 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-1a44f37d-e9b8-43b3-8239-4fc552300720 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Feb 28 10:25:16.120320 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 21/43] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:25:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:25:16.312529 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-77280d35-27d1-4953-8050-4a3a0fbc4a5e admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:16.317804 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.wsgi [None req-77280d35-27d1-4953-8050-4a3a0fbc4a5e admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 28 10:25:16.318355 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-77280d35-27d1-4953-8050-4a3a0fbc4a5e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:25:16.320246 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-77280d35-27d1-4953-8050-4a3a0fbc4a5e admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057792 Feb 28 10:25:16.320750 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 23/44] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Feb 28 10:25:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:16.329921 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-5b6dc55c-5cea-4b4a-834f-f326cceffecf admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:16.344382 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-5b6dc55c-5cea-4b4a-834f-f326cceffecf admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018006 Feb 28 10:25:16.344898 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 22/45] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 10:25:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:25:16.353949 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-845dbe31-33fe-4732-8704-750b8787c7ab admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:16.367515 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-845dbe31-33fe-4732-8704-750b8787c7ab admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016994 Feb 28 10:25:16.367982 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 24/46] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 10:25:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:25:16.376968 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-3ef81d55-6e1f-409e-b2c3-e57ce02036b1 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:16.382748 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.wsgi [None req-3ef81d55-6e1f-409e-b2c3-e57ce02036b1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 28 10:25:16.383309 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-3ef81d55-6e1f-409e-b2c3-e57ce02036b1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:25:16.384099 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-3ef81d55-6e1f-409e-b2c3-e57ce02036b1 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010680 Feb 28 10:25:16.384590 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 23/47] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Feb 28 10:25:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:17.677895 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-845dbe31-33fe-4732-8704-750b8787c7ab admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:17.679218 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-845dbe31-33fe-4732-8704-750b8787c7ab admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Feb 28 10:25:17.679616 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 25/48] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:25:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:25:17.869354 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-457cfd08-b00a-46e3-a36a-205910064450 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:17.874496 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.wsgi [None req-457cfd08-b00a-46e3-a36a-205910064450 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 28 10:25:17.875088 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-457cfd08-b00a-46e3-a36a-205910064450 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:25:17.875877 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-457cfd08-b00a-46e3-a36a-205910064450 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058341 Feb 28 10:25:17.876374 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 24/49] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 10:25:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:17.886718 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-3c109d24-db78-4bf8-8cd1-00578605c344 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:17.901003 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-3c109d24-db78-4bf8-8cd1-00578605c344 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017791 Feb 28 10:25:17.901468 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 26/50] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 10:25:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:25:17.912314 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:17.925315 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018159 Feb 28 10:25:17.925839 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 25/51] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 10:25:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:25:17.935435 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-bb297de7-4272-41b5-a407-e769cfd783d7 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:17.940499 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.wsgi [None req-bb297de7-4272-41b5-a407-e769cfd783d7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 28 10:25:17.941083 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-bb297de7-4272-41b5-a407-e769cfd783d7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:25:17.941851 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-bb297de7-4272-41b5-a407-e769cfd783d7 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009979 Feb 28 10:25:17.942327 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 27/52] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 10:25:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:19.217100 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:19.218118 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Feb 28 10:25:19.219834 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 26/53] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:25:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:25:19.408661 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-5dad71af-fbe7-4445-89e2-26d5b411bff7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:25:19.427776 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-5dad71af-fbe7-4445-89e2-26d5b411bff7 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069926 Feb 28 10:25:19.428754 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 28/54] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Feb 28 10:25:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:25:20.728598 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:20.729608 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Feb 28 10:25:20.730011 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 27/55] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:25:20.921359 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-48ee4f05-ad6b-4ed9-8709-428f3660486a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:25:20.938881 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-48ee4f05-ad6b-4ed9-8709-428f3660486a admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068950 Feb 28 10:25:20.939453 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 29/56] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Feb 28 10:25:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:25:22.220413 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:22.221462 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Feb 28 10:25:22.222217 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 28/57] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:25:22.412774 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-1624a2ff-acff-4edb-a2cd-5878b0acb30e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:25:22.429515 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-1624a2ff-acff-4edb-a2cd-5878b0acb30e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067296 Feb 28 10:25:22.429965 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 30/58] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Feb 28 10:25:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:25:23.718259 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:23.719245 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Feb 28 10:25:23.719633 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 29/59] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:25:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:25:23.908110 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-e1bbd877-35b8-4d20-8a2a-076a14481ea0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:25:23.925082 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-e1bbd877-35b8-4d20-8a2a-076a14481ea0 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067409 Feb 28 10:25:23.925616 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 31/60] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Feb 28 10:25:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:25:25.223514 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:25.224549 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Feb 28 10:25:25.224950 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 30/61] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:25:25.415583 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-71c988d9-13b1-4326-ac85-e15c64dfe629 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:25:25.434895 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-71c988d9-13b1-4326-ac85-e15c64dfe629 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069975 Feb 28 10:25:25.435364 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 32/62] 10.222.0.21 () {60 vars in 1202 bytes} [Mon Feb 28 10:25:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:26:16.169965 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:26:16.171012 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-83e8e212-1479-48de-8c8d-060e33859ec2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Feb 28 10:26:16.171409 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 31/63] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 10:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:26:16.228341 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-7cac9c7e-9b48-47ea-a585-bef5963b4316 admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:26:16.247471 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-7cac9c7e-9b48-47ea-a585-bef5963b4316 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069703 Feb 28 10:26:16.247992 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 33/64] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Feb 28 10:26:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:26:16.269764 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-0f3458bd-d540-4aa9-9a63-472ef3d4848c admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:26:16.277291 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-0f3458bd-d540-4aa9-9a63-472ef3d4848c admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011221 Feb 28 10:26:16.277816 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 32/65] 10.222.0.21 () {60 vars in 1282 bytes} [Mon Feb 28 10:26:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:26:16.289571 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-705c1221-ff45-4f7f-8199-434823de472e admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:26:16.297019 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-705c1221-ff45-4f7f-8199-434823de472e admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011023 Feb 28 10:26:16.297523 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 34/66] 10.222.0.21 () {60 vars in 1285 bytes} [Mon Feb 28 10:26:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:26:16.309499 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-2da58801-56cf-4766-9c15-7c3703de7c11 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:26:16.317247 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-2da58801-56cf-4766-9c15-7c3703de7c11 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011221 Feb 28 10:26:16.317753 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 33/67] 10.222.0.21 () {60 vars in 1285 bytes} [Mon Feb 28 10:26:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:26:16.328262 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:26:16.336286 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011448 Feb 28 10:26:16.336835 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 35/68] 10.222.0.21 () {60 vars in 1282 bytes} [Mon Feb 28 10:26:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:27:51.735499 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-353285e2-55f5-4dd9-a1d3-e71fa62a1add tempest-verify_tempest_config-333336948 tempest-verify_tempest_config-333336948-project] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:27:51.737513 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-353285e2-55f5-4dd9-a1d3-e71fa62a1add tempest-verify_tempest_config-333336948 tempest-verify_tempest_config-333336948-project] 10.222.0.21 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106515 Feb 28 10:27:51.738044 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 34/69] 10.222.0.21 () {58 vars in 1133 bytes} [Mon Feb 28 10:27:51 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:29:29.363214 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:29:29.364231 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Feb 28 10:29:29.364629 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 36/70] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:29:29.622460 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-c2132a90-eb41-487c-888e-973aaf12c956 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:29:29.623732 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:29:29.623732 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: warnings.warn(msg) Feb 28 10:29:29.625200 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-c2132a90-eb41-487c-888e-973aaf12c956 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:29:29.625721 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-c2132a90-eb41-487c-888e-973aaf12c956 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:29:29.626671 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-c2132a90-eb41-487c-888e-973aaf12c956 admin admin] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:29:29.627171 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-c2132a90-eb41-487c-888e-973aaf12c956 admin admin] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:29:29.661176 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-c2132a90-eb41-487c-888e-973aaf12c956 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152889 Feb 28 10:29:29.661735 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 35/71] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 10:29:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:29:30.941558 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:29:30.942566 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Feb 28 10:29:30.942993 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 37/72] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:29:31.134288 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-f6a05410-6f58-4bed-a69e-e4bd9cd58810 admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:29:31.135506 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:29:31.135506 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: warnings.warn(msg) Feb 28 10:29:31.136733 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-f6a05410-6f58-4bed-a69e-e4bd9cd58810 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:29:31.137184 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-f6a05410-6f58-4bed-a69e-e4bd9cd58810 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:29:31.137992 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-f6a05410-6f58-4bed-a69e-e4bd9cd58810 admin admin] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:29:31.138434 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-f6a05410-6f58-4bed-a69e-e4bd9cd58810 admin admin] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:29:31.157644 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-f6a05410-6f58-4bed-a69e-e4bd9cd58810 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074293 Feb 28 10:29:31.158192 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 36/73] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 10:29:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:29:42.956794 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:29:42.957832 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Feb 28 10:29:42.958254 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 38/74] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:29:43.149050 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-0e74f18b-05a9-4dd7-ada5-62f1d71008ab admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:29:43.150207 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:29:43.150207 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: warnings.warn(msg) Feb 28 10:29:43.151430 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-0e74f18b-05a9-4dd7-ada5-62f1d71008ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:29:43.151873 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-0e74f18b-05a9-4dd7-ada5-62f1d71008ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:29:43.153588 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-0e74f18b-05a9-4dd7-ada5-62f1d71008ab admin admin] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:29:43.154023 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-0e74f18b-05a9-4dd7-ada5-62f1d71008ab admin admin] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:29:43.178571 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-0e74f18b-05a9-4dd7-ada5-62f1d71008ab admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079901 Feb 28 10:29:43.179131 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 37/75] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 10:29:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:29:44.487761 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: DEBUG nova.api.openstack.wsgi [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] Calling method '>' {{(pid=102069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:29:44.488831 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: INFO nova.api.openstack.requestlog [None req-8fc40a45-38ab-4630-81b0-59c66acff15e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Feb 28 10:29:44.489227 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: [pid: 102069|app: 0|req: 39/76] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 10:29:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:29:44.683272 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG nova.api.openstack.wsgi [None req-1e6db165-6d14-4e07-a0fd-ad5b2491244d admin admin] Calling method '>' {{(pid=102068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:29:44.684431 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:29:44.684431 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: warnings.warn(msg) Feb 28 10:29:44.685634 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-1e6db165-6d14-4e07-a0fd-ad5b2491244d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:29:44.686078 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-1e6db165-6d14-4e07-a0fd-ad5b2491244d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:29:44.686905 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-1e6db165-6d14-4e07-a0fd-ad5b2491244d admin admin] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:29:44.687363 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: DEBUG oslo_concurrency.lockutils [None req-1e6db165-6d14-4e07-a0fd-ad5b2491244d admin admin] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:29:44.708357 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: INFO nova.api.openstack.requestlog [None req-1e6db165-6d14-4e07-a0fd-ad5b2491244d admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076766 Feb 28 10:29:44.708837 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: [pid: 102068|app: 0|req: 38/77] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 10:29:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:30:46.056230 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: Mon Feb 28 10:30:46 2022 - graceful shutdown triggered... Feb 28 10:30:46.056745 dv-cinder-master-3-iscsi devstack@n-api.service[102069]: Gracefully killing worker 2 (pid: 102069)... Feb 28 10:30:46.057109 dv-cinder-master-3-iscsi devstack@n-api.service[102068]: Gracefully killing worker 1 (pid: 102068)... Feb 28 10:30:46.058482 dv-cinder-master-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 28 10:30:47.057370 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: worker 1 buried after 1 seconds Feb 28 10:30:47.057370 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: worker 2 buried after 1 seconds Feb 28 10:30:47.057370 dv-cinder-master-3-iscsi devstack@n-api.service[102067]: goodbye to uWSGI. Feb 28 10:30:47.059826 dv-cinder-master-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 28 10:30:47.060374 dv-cinder-master-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 28 10:30:47.063166 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 28 10:30:47.074052 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 10:30:47 2022] *** Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: nodename: dv-cinder-master-3-iscsi Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: machine: x86_64 Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: clock source: unix Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: pcre jit disabled Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: detected number of CPU cores: 4 Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: current working directory: / Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: detected binary path: /usr/bin/uwsgi-core Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: your processes number limit is 47680 Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: your memory page size is 4096 bytes Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: detected max file descriptor number: 2048 Feb 28 10:30:47.076866 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: lock engine: pthread robust mutexes Feb 28 10:30:47.077717 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: thunder lock: enabled Feb 28 10:30:47.077717 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 28 10:30:47.077717 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 10:30:47.124613 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: Python main interpreter initialized at 0x5632345739c0 Feb 28 10:30:47.124613 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: python threads support enabled Feb 28 10:30:47.124613 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: your server socket listen backlog is limited to 100 connections Feb 28 10:30:47.124613 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: your mercy for graceful operations on workers is 90 seconds Feb 28 10:30:47.125059 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 10:30:47.125059 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: *** Operational MODE: preforking *** Feb 28 10:30:47.125338 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: *** uWSGI is running in multiple interpreter mode *** Feb 28 10:30:47.125338 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: spawned uWSGI master process (pid: 123136) Feb 28 10:30:47.125541 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 28 10:30:47.126140 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: spawned uWSGI worker 1 (pid: 123151, cores: 1) Feb 28 10:30:47.126686 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: spawned uWSGI worker 2 (pid: 123152, cores: 1) Feb 28 10:30:47.126982 dv-cinder-master-3-iscsi devstack@n-api.service[123136]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 10:30:49.069889 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:30:49.069889 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: from cryptography.utils import int_from_bytes Feb 28 10:30:49.070576 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:30:49.070576 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: from cryptography.utils import int_from_bytes Feb 28 10:30:49.073843 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:30:49.073843 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: from cryptography.utils import int_from_bytes Feb 28 10:30:49.074341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:30:49.074341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: from cryptography.utils import int_from_bytes Feb 28 10:30:51.501622 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 10:30:51.502165 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 10:30:51.502437 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 10:30:51.502784 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 10:30:51.503049 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 10:30:51.503444 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.503775 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.504103 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.504430 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.504770 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.505086 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.505244 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 10:30:51.505641 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.505731 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 10:30:51.505822 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.506012 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 10:30:51.506107 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.506300 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.506399 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 10:30:51.506640 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.506737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 10:30:51.506981 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.507075 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.507311 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.507403 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.507625 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.507724 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.507942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.508039 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.508270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.508378 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.508579 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.508690 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.508908 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.509001 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.509220 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.509313 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.509588 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.509726 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.509841 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.510178 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.510313 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.510485 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.510667 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.510826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.510965 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.511336 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.511496 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.511596 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.511697 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.511920 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.512240 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.512367 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.512468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.512560 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.512659 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.512768 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.512871 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.513078 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.513391 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.513572 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.513711 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.513818 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.514025 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.514118 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.514345 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.514486 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.514721 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.514863 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.515047 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.515158 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.515365 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.515458 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.515697 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.515799 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.516016 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.516117 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.516355 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.516456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.516674 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.516766 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.517038 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.517130 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.517366 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.517460 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.517695 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.517797 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.518004 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.518107 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.518321 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.518415 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.518653 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.518837 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.518985 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.519159 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.519307 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.519490 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.519592 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.519824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.519930 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.520145 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.520245 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.520472 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.520562 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.520802 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.520907 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.521131 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.521233 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.521391 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.521491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.521708 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.521803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.521965 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.522140 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.522276 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.522380 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.522719 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.522869 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.522991 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.523129 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.523415 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.524394 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.524544 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.524666 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.524779 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.524898 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.525033 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.525147 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.525266 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.525379 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.525498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.525617 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.525617 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.525850 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.525970 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.526083 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.526205 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.526329 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.526450 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.526562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.526710 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.526832 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.526945 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.530708 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.530830 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.530915 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531001 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531085 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531162 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531251 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531334 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531409 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531490 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531589 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531679 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531769 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531845 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.531926 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532001 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532170 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532253 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532338 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532420 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532504 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532676 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532758 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532840 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532915 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.532995 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533077 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533165 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533247 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533331 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533502 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533583 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533676 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533836 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.533917 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.534007 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.534094 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.534094 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.534241 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.534348 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.534450 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.534527 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.534627 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.535266 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.535376 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.535453 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.535527 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.535527 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.535675 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.535748 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.535820 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.536030 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.536128 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.536291 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.536393 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.536579 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.536691 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.536897 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.537000 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.537217 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.537329 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.537527 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.537637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.537843 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.537945 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.538155 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.538280 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.538458 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.538562 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.539004 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.539109 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.539193 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.539277 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.539446 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.539608 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.539766 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.539914 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.540094 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.540251 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.540419 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.540579 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.540735 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.540895 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.541054 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.541201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.541359 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.541520 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.541677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.541898 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.542056 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.542215 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.542373 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.542521 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.542521 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.542863 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.542863 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.543784 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.543935 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.544093 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.544328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.544567 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.544722 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.544880 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.545028 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.545176 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.545336 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.545498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.545665 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.545822 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.545977 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.546132 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.546295 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.546455 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.546630 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.546784 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.546958 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.547187 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.547357 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.547507 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.547737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.547909 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.548065 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.548222 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.548381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.548540 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.548697 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.548872 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.549305 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.549461 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.549695 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.549846 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.550002 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.550225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.550393 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.550557 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.550765 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.550925 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.551082 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.551236 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.551391 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.551556 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.551713 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.551870 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.552026 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.552190 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.552363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.552523 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.552682 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:30:51.552831 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.552986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.553143 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.553305 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.553463 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.553612 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.553768 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.553926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.554084 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.554245 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.554406 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.554572 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.554811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.554964 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.555127 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.555286 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.555434 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.555655 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.555806 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.555954 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.556116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.556274 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.556452 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.556601 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.556756 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.556905 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.557053 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.557225 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.557452 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.557613 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.557777 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.557993 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.558144 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.558330 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.559492 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.559677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.559839 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.559999 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.560157 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.560316 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.560483 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.560725 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.560879 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.561037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.561037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.561341 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.561491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.561647 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.561647 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.561948 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.562185 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.562349 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.562507 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.562731 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.562894 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.563055 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.563218 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.563375 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.563524 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.563680 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.563849 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.564007 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.564167 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.564315 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.564463 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.564611 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.564760 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.565007 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.565176 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.565332 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.565489 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.565638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.565794 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.565963 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.566123 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.566322 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.566477 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.566652 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.566818 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.566974 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.567137 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.567298 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.567473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.567772 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.567927 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.568172 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.568347 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.568497 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.568652 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.568800 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.568948 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.569106 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.569468 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.569625 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.569878 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.570040 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.570198 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.570358 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.570515 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.570744 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.570898 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.571055 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.571204 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.571366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.571524 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.571681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.571830 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.571986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.572156 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.572316 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.572475 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.572624 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.572783 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.572938 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.573102 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.573258 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.573485 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.573638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.573786 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.573934 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.574103 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.574255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.574405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.574553 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.574735 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.574896 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.575141 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.575305 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.575454 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.575611 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.575760 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.575921 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.576078 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.576237 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.576385 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.576533 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.576682 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.576850 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.577008 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.577157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.577313 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.577469 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.577625 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.577872 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.578035 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.578211 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.578429 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.578581 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.578581 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.579062 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.579225 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.579593 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.579750 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.579926 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.580175 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.580328 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.580486 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.580634 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.580634 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.580924 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.581082 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.581239 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.581403 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.581552 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.581709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.581870 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.582289 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.582439 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.582588 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.582839 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.582998 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.583156 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.583319 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.583479 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.583628 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.583796 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.583953 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.584117 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.584286 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.584531 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.584727 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.584902 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.585055 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.585304 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.585499 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.585654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.585803 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.586005 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.586005 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.586316 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.586465 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.586656 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.586822 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.586972 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.587120 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.587283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.587439 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.587588 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.587743 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.587974 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.588138 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.588540 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.588704 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.588862 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.589020 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.589170 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.589333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.589697 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.590526 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.590716 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.590878 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.591037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.591201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.591360 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.591571 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.591729 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.591879 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.592027 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.592197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.592349 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.592498 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.592654 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.592812 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.593013 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.593187 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.593345 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.593504 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.593664 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.593813 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.594008 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.594161 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.594310 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.594466 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.594670 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.594835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.594998 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.595157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.595337 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.595560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.595733 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.595920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.596101 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.596261 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.596418 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.596567 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.596723 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.596871 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.597032 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.597188 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.597344 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.597500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.597650 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.597822 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.597991 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.598210 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.598370 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.598537 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.598787 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.598955 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.599114 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.599263 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.599411 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.599559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.599916 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.600080 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.600921 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.601082 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.601232 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.601391 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.601540 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.601699 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.601849 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.601999 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.602153 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.602307 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.602465 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.602800 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.602995 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.603170 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.603327 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.603476 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.603638 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.603796 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.603954 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.604103 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.604262 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.604411 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.604577 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.604734 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.604890 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.605060 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.605216 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.605366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.606078 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.606306 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.606459 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.606627 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.606781 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.606944 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.607096 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.607253 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.607403 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.607551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.607711 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.607869 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.608018 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.608193 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.608413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.608575 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.608751 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.608986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.609140 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.609289 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.609438 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.609596 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.609745 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.610138 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.610291 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.610440 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.610615 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.610817 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.611106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.611271 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.611421 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.611570 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.611718 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.611913 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.612075 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.612241 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.612405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.612555 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.612702 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.612859 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.613098 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.613249 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.613406 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.613562 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.613736 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.614067 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.614230 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.614230 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.614536 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.614846 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.615003 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.615152 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.615310 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.615509 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.615675 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.615831 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.615987 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.616157 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.616337 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.616569 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.616729 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.616897 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.617061 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.617232 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.617389 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.617552 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.617716 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.617872 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.618036 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.618202 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.618358 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.618637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.618802 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.618976 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.619212 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.619390 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.619555 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.619555 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.619868 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.620261 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.620436 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.620593 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.620750 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.620906 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.621116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.621367 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.621544 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.621721 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.621887 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.622051 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.622213 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.622370 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.622539 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.622733 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.622891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.623059 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.623217 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.623380 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.623551 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.623551 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.623867 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.624078 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.624239 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.624394 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.624558 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.624722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.627574 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.627775 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.627952 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.628116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.628275 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.628433 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.628718 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.628899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.629057 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.629232 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.629232 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.629613 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.629793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.629951 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.630361 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.630539 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.630741 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.630915 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.631080 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.631252 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.631527 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.631689 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.631689 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.631996 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.632167 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.632327 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.632491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.632657 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.632822 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.632986 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.633141 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.633309 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.633485 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.633651 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.633816 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.633972 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.634135 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.634292 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.634449 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.634686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.634849 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.635017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.635174 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.635338 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.635521 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.635691 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.635848 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.636004 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.636158 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.636313 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.636479 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.637171 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.637415 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.637590 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.637755 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.637918 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.638088 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.638256 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.638412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.638576 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.638835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.639009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.639177 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.639341 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.639591 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.639755 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.639920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.640084 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.640268 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.640642 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.640642 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.640966 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.641122 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.641286 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.641494 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.641768 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.641937 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.642094 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.642260 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.642426 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.642592 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.642784 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.642941 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.643114 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.643278 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.643449 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.643613 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.643770 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.643926 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.644090 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.644246 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.644411 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.644568 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.644724 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.644889 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.645064 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.645234 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.645405 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.645597 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.645764 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.645920 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.646076 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.646309 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.646476 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.646676 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.646846 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.647003 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.647159 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.647339 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.647592 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.647753 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.647910 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.648067 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.648221 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.648390 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.648547 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.648701 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.648881 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.649106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.649282 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.649446 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.649695 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.649695 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.650004 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.650169 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.650335 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.650518 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.650905 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.651062 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.651226 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.651391 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.651558 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.651558 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.651971 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.652157 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.652393 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.652560 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.652726 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.652726 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.653031 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.653193 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.653350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.653515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.653671 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.653671 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.653974 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.654130 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.654306 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.654479 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.654685 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.654847 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.655011 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.655167 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.655330 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.655495 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.655652 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.655806 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.655969 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.655969 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.656282 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.656450 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.656606 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.656762 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.656931 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.657094 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.657260 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.657419 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.657600 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.657844 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.658013 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.658170 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.658340 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.658508 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.658705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.658864 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.659019 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.659271 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.659443 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.659601 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.659854 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.660023 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.660179 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.660342 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.660508 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.660685 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.661156 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.661318 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.661474 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.661653 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.661811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.661966 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.662121 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.662390 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.662549 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.662767 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.662936 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.663107 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.663271 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.663440 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.663596 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.663766 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.663922 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.664085 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.664249 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.664412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.664568 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.664732 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.664896 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.665052 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.665207 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.665363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.665530 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.665773 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.665947 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.666110 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.666275 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.666447 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.666691 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.666868 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.667028 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.667191 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.667347 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.667502 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.667686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.669211 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.669484 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.669659 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.669837 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.670076 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.670260 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.670418 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.670574 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.670766 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.670951 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.671332 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.671507 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.671677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.671834 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.671990 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.672155 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.672333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.672605 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.672774 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.672939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.673096 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.673096 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.673402 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.673560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.673715 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.673894 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.674051 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.674216 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.674387 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.674544 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.674724 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.674892 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.675049 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.675204 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.675370 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.675536 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.675693 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.675849 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.676027 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.676194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.676361 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.676525 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.677180 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.677358 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.677517 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.677684 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.677842 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.678006 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.678163 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.678318 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.678495 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.678707 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.678870 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.679027 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.679208 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.679454 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.679692 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.679869 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.680053 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.680285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.680446 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.680446 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.680835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.681014 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.681189 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.681539 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.681703 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.681703 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.682017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.682175 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.682289 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.682381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.682518 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.682641 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.682761 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.682860 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.682957 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.683054 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.683165 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.683413 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.683866 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.684037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.684155 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.684269 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.684385 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.684515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.684640 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.684770 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.684894 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.685017 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.685140 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.685264 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.685380 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.685503 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.685618 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.685816 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.685942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.686068 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.686184 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.686184 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.686428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.686552 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.686693 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.686810 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.686962 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.687098 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.687231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.687231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.687500 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.687644 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.687778 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.687920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.688054 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.688197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.688344 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.688490 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.688624 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.688765 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.688765 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.689030 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.689163 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.689296 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.689453 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.689679 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.689679 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.690024 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.690159 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.690319 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.690527 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.690700 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.690855 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.691001 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.691143 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.691285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.691609 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.691749 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.691898 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.692035 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.692176 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.692309 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.692448 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.692600 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.692743 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.692877 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.693011 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.693197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.693339 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.693595 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.693748 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.693961 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.694106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.694248 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.694390 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.694534 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.694686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.694820 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.694954 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.695100 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.695245 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.695388 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.695531 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.695673 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.695814 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.695948 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.696090 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.696238 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.696380 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.696514 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.696656 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.696798 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.696947 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.697082 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.697224 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.697359 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.697502 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.697642 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.697794 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.697928 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.698070 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.698212 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.698355 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.698498 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.698709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.698845 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.698979 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.699656 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.699891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.700107 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.700245 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.700390 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.700547 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.700746 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.700882 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.701032 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.701032 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.701032 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.701032 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.701032 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.701811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.701811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.702147 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.702281 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.702420 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.702556 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.702723 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.702870 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.703005 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.703210 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.703345 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.703478 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.703642 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.703867 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.704085 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.704222 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.704356 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.704489 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.704489 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.704760 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.704903 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.705045 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.705181 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.705181 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.705478 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.705619 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.705619 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.705887 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.706029 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.706173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.706316 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.706316 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.706568 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.706719 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.706853 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.707248 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.707248 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.707502 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.707643 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.707787 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.707921 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.707921 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.708192 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.708334 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.708475 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.708610 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.708610 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.708889 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.709024 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.709158 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.709301 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.709301 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.709563 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.709698 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.709856 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.710074 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.710074 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.710393 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.710393 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.710895 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.710895 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.711160 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.711294 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.711294 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.711576 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.711852 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.712034 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.712178 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.712178 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.712450 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.712600 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.712600 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.712863 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.713006 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.713006 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.713282 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.713425 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.713567 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.713709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.713709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.714103 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.714320 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.714320 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.714613 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.714829 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.714998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.715135 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.715135 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.715451 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.715595 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.715740 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.715882 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.715882 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.716154 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.716296 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.716296 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.716562 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.716698 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.716846 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.716988 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.716988 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.717251 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.717393 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.717393 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.717661 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.717796 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.717796 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.718058 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.718200 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.718200 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.718477 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.718649 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.718787 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.718923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.718923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.719191 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.719335 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.719335 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.719589 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.719589 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.719851 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.720009 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.720230 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.720457 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.720595 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.720595 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.720871 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.721070 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.721220 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.721363 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.721363 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.721634 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.721783 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.722071 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.722219 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.722219 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.722489 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.722640 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.722797 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.722931 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.722931 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.723201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.723335 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.723489 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.723632 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.723632 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.723900 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.724035 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.724035 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.724520 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.724661 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.724803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.724803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.725064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.725064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.725381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.725517 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.725517 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.725780 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.725914 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.726058 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.726200 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.726200 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.726461 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.726648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.726648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.726933 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.727068 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.727068 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.727338 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.727473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.727607 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.727761 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.727761 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.728014 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.728148 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.728148 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.728409 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.728544 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.728690 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.728834 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.728834 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.729095 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.729244 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.729385 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.729527 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.729527 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.729810 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.729953 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.729953 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.730232 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.731020 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.731252 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.731399 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.731399 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.731662 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.731798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.731798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.732196 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.732342 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.732342 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.732681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.732827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.732827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.733090 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.733239 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.733239 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.733515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.733651 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.733792 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.733926 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.733926 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.734197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.734434 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.734434 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.734847 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.734983 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.735125 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.735270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.735270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.735541 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.735675 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.735675 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.735937 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.736074 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.736792 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.736945 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.737091 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.737234 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.737234 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.737495 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.737638 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.737786 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.737934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.737934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.738205 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.738347 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.738496 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.738658 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.738658 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.738926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.739061 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.739061 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.739454 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.739608 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.739756 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.739891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.739891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.739891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.740285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.740429 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.740570 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.740719 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.740719 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.741156 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.741387 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.741524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.741667 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.741667 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.741928 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.742077 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.742371 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.742524 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.742702 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.742852 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.742852 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.743115 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.743250 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.743393 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.743537 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.743537 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.743800 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.743945 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.743945 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.744207 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.744349 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.744595 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.744832 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.744832 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.745108 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.745242 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.745385 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.745520 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.745663 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.745798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.745798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.746195 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.746411 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.746411 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.746744 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.746883 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.747017 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.747151 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.747151 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.747414 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.747557 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.747557 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.747821 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.747963 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.748107 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.748256 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.748399 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.748534 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.748534 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.748794 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.748935 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.749080 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.749449 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.749559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.749649 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.749649 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.749824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.749923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.749923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.750082 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.750169 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.750262 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.750360 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.750360 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.750533 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.750638 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.750945 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.751091 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.751091 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.751091 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.751091 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.751091 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.751965 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.752055 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.752159 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.752257 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.752504 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.752603 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.752692 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.752797 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.752902 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.752991 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753079 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753171 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753267 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753365 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753461 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753550 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753637 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753723 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753810 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.753906 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.754139 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.754237 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.754455 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.754557 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.754820 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.754965 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.755148 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.755265 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.755498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.755602 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.755830 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.755986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.756131 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.756409 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.756556 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.756762 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.756916 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.757088 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.757237 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.757422 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.757565 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.757745 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.757897 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.758047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.758313 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.758452 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.758621 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.758765 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.758870 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.759037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.759131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.759369 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.759504 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.759677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.759778 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.759993 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.760094 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.760313 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.760413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.760635 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.760738 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.760956 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.761063 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.761271 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.761408 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.762166 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.762776 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.762878 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.762976 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.763064 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.763160 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.763256 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.763344 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.763438 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.763533 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.763687 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.763796 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.764040 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.764134 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.764357 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.764459 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.764681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.764798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.765005 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.765098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.765331 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.765501 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.765654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.765813 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.765961 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.766105 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.766261 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.766434 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.766545 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.766671 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.766886 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.766996 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.767225 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.767331 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.767547 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.767656 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.767867 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.767973 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.768266 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.768362 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.768606 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.768704 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.768928 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.769033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.769250 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.769361 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.769565 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.769673 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.769815 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 10:30:51.769914 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.770211 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.770531 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.770946 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.771264 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.771605 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.771952 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.772290 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.772646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.772932 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.773242 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.773552 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.773867 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.774193 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.774509 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.774847 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.775160 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.775477 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.775786 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.776192 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.776411 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.776720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.777037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.777424 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.777742 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.778054 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.778363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.778698 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.779013 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.779332 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.779681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.779960 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.780265 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.780577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.780884 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.781226 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.781607 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.781886 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.782220 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.782542 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.783551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.783551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.783551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.783945 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.784151 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.784480 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.784810 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.785138 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.785468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.785771 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.786091 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.786409 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.786749 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.787091 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.787429 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.788110 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.788257 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.788606 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.788823 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.789151 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.789473 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.789821 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.790146 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.790483 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.790822 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.791148 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.791472 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.791801 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.792125 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.792467 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.792805 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.793538 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_db.sqlalchemy.engines [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:30:51.793700 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.793997 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.794356 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.794751 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.795116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.795461 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.795783 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.796106 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.796420 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:30:51.796672 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 10:30:51.819577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_db.sqlalchemy.engines [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:30:51.857720 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.context [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c755071f-4a59-4a8e-8ef6-dfe2026d3c30(cell1) {{(pid=123151) load_cells /opt/stack/nova/nova/context.py:464}} Feb 28 10:30:51.861974 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:30:51.863602 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:30:51.864443 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:30:51.866391 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:30:51.878029 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_db.sqlalchemy.engines [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:30:51.879576 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_db.sqlalchemy.engines [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:30:51.883925 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.context [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c755071f-4a59-4a8e-8ef6-dfe2026d3c30(cell1) {{(pid=123152) load_cells /opt/stack/nova/nova/context.py:464}} Feb 28 10:30:51.888273 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:30:51.889877 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:30:51.890782 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:30:51.892710 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:30:51.903585 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_db.sqlalchemy.engines [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:30:51.904639 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_db.sqlalchemy.engines [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:30:52.044959 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_db.sqlalchemy.engines [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:30:52.064161 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_db.sqlalchemy.engines [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:30:52.376466 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: WARNING keystonemiddleware.auth_token [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 10:30:52.500757 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: WARNING keystonemiddleware.auth_token [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 10:30:52.512673 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: WARNING keystonemiddleware.auth_token [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 10:30:52.519318 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: WARNING keystonemiddleware.auth_token [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 10:30:52.741956 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: WARNING keystonemiddleware.auth_token [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 10:30:52.745386 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: WARNING keystonemiddleware.auth_token [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 10:30:52.748026 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: WARNING keystonemiddleware.auth_token [None req-16c1fbcb-950e-456d-a981-7f9cbca96d90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 10:30:52.751264 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: WARNING keystonemiddleware.auth_token [None req-41ae8308-4d0f-45e9-b5b3-e21964e2d795 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 10:30:52.753375 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5632345739c0 pid: 123151 (default app) Feb 28 10:30:52.756573 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5632345739c0 pid: 123152 (default app) Feb 28 10:31:33.456684 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-05bf6ddd-b54a-4782-8762-19ea7aa28ff7 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] Action: 'create', calling method: .version_select at 0x7f1c591724c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1359468423", "metadata": {"Type": "work"}}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:33.748357 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-139926fa-4035-4cd5-996e-469f7fe2537d tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Action: 'create', calling method: .version_select at 0x7f1c591b7f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1726216435", "metadata": {"Type": "work"}}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:33.750114 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-139926fa-4035-4cd5-996e-469f7fe2537d tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:31:33.751331 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-139926fa-4035-4cd5-996e-469f7fe2537d tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.419824 Feb 28 10:31:33.761999 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 1/1] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 10:31:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1432 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 28 10:31:33.768664 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a1b7d48a-d0e8-42a1-9073-01282cb23550 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Action: 'create', calling method: .version_select at 0x7f1c59157d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-940581248", "metadata": {"Type": "work"}}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:33.777699 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a1b7d48a-d0e8-42a1-9073-01282cb23550 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:31:33.777699 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a1b7d48a-d0e8-42a1-9073-01282cb23550 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007936 Feb 28 10:31:33.780920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 2/2] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 10:31:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 28 10:31:33.788934 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-31caabd4-ae9d-439e-ba76-5a7ce7ac77b5 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Action: 'create', calling method: .version_select at 0x7f1c59157b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1766080064", "metadata": {"Type": "work"}}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:33.793189 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-31caabd4-ae9d-439e-ba76-5a7ce7ac77b5 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:31:33.793917 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-31caabd4-ae9d-439e-ba76-5a7ce7ac77b5 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011982 Feb 28 10:31:33.798486 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 3/3] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 10:31:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 28 10:31:33.805858 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-57005f84-ffd3-485f-9b76-6f2efac82b48 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Calling method '.version_select at 0x7f1c590f69d0>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:34.873980 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-57005f84-ffd3-485f-9b76-6f2efac82b48 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] HTTP exception thrown: Volume tempest-invalid-668823543 could not be found. Feb 28 10:31:34.874921 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-57005f84-ffd3-485f-9b76-6f2efac82b48 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Returning 404 to user: Volume tempest-invalid-668823543 could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:31:34.875790 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-57005f84-ffd3-485f-9b76-6f2efac82b48 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/tempest-invalid-668823543" status: 404 len: 98 microversion: 2.1 time: 1.075275 Feb 28 10:31:34.876658 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 4/4] 10.222.0.21 () {58 vars in 1214 bytes} [Mon Feb 28 10:31:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-668823543 => generated 98 bytes in 1076 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 28 10:31:35.219738 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-586622986", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "networks": [{"uuid": "1fc7adb1-5f6e-49b1-9f69-c85127612f56"}]}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:35.288895 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-05bf6ddd-b54a-4782-8762-19ea7aa28ff7 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.368430 Feb 28 10:31:35.289533 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 1/5] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 10:31:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3371 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 28 10:31:35.303056 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0bdea690-626b-49a4-8e43-510638901e8a tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004360 Feb 28 10:31:35.305016 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 2/6] 10.222.0.21 () {58 vars in 1139 bytes} [Mon Feb 28 10:31:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 28 10:31:35.312595 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-da184cec-f9fb-4251-8024-2b854746bf72 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] Calling method '.version_select at 0x7f1c5903c700>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:35.454189 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.network.neutron [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] validate_networks() for [('1fc7adb1-5f6e-49b1-9f69-c85127612f56', None, None, None, None, None)] {{(pid=123152) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:31:35.483615 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-da184cec-f9fb-4251-8024-2b854746bf72 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c" status: 200 len: 353 microversion: 2.1 time: 0.177567 Feb 28 10:31:35.486917 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 3/7] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:31:35 2022] GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:31:35.492887 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e5b2cffc-447b-4c18-ad46-286454343504 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004759 Feb 28 10:31:35.493562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 4/8] 10.222.0.21 () {58 vars in 1136 bytes} [Mon Feb 28 10:31:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 28 10:31:35.506026 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f99527c4-1dc1-4543-9135-c6583e618023 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Calling method '.version_select at 0x7f1c5903c670>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:35.587632 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-f99527c4-1dc1-4543-9135-c6583e618023 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] HTTP exception thrown: Volume 833f6c57-4190-4bb0-a076-2014e5d1f4fc could not be found. Feb 28 10:31:35.588496 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f99527c4-1dc1-4543-9135-c6583e618023 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Returning 404 to user: Volume 833f6c57-4190-4bb0-a076-2014e5d1f4fc could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:31:35.590197 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f99527c4-1dc1-4543-9135-c6583e618023 tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/833f6c57-4190-4bb0-a076-2014e5d1f4fc" status: 404 len: 109 microversion: 2.1 time: 0.090835 Feb 28 10:31:35.590875 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 5/9] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 10:31:35 2022] DELETE /compute/v2.1/os-volumes/833f6c57-4190-4bb0-a076-2014e5d1f4fc => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:31:35.607389 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b4af6506-28fb-4394-b48e-d98549f3a8ec tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Calling method '.version_select at 0x7f1c59172e50>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:35.670487 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-b4af6506-28fb-4394-b48e-d98549f3a8ec tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] HTTP exception thrown: Volume fdbc6dc1-fe5c-4289-aaf2-da6952382342 could not be found. Feb 28 10:31:35.674844 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b4af6506-28fb-4394-b48e-d98549f3a8ec tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] Returning 404 to user: Volume fdbc6dc1-fe5c-4289-aaf2-da6952382342 could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:31:35.676061 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b4af6506-28fb-4394-b48e-d98549f3a8ec tempest-VolumesNegativeTest-1995048091 tempest-VolumesNegativeTest-1995048091-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fdbc6dc1-fe5c-4289-aaf2-da6952382342" status: 404 len: 109 microversion: 2.1 time: 0.078751 Feb 28 10:31:35.676734 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 6/10] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:31:35 2022] GET /compute/v2.1/os-volumes/fdbc6dc1-fe5c-4289-aaf2-da6952382342 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:31:36.503700 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a6b06a9b-2344-4a5e-89b5-3d859f6f89de tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] Calling method '.version_select at 0x7f1c5905e310>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:36.588101 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a6b06a9b-2344-4a5e-89b5-3d859f6f89de tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c" status: 200 len: 354 microversion: 2.1 time: 0.095227 Feb 28 10:31:36.590434 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 7/11] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:31:36 2022] GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:31:36.604476 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-319a763c-6621-41b6-a951-41862138f522 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] Calling method '.version_select at 0x7f1c5905e9d0>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:36.725506 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-319a763c-6621-41b6-a951-41862138f522 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c" status: 200 len: 354 microversion: 2.1 time: 0.127678 Feb 28 10:31:36.726124 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 8/12] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:31:36 2022] GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:31:36.740548 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-deffa52a-017d-4d0b-a01f-f5fffd75b2d7 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] Calling method '.version_select at 0x7f1c5903cc10>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:36.850064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-deffa52a-017d-4d0b-a01f-f5fffd75b2d7 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c" status: 202 len: 0 microversion: 2.1 time: 0.115873 Feb 28 10:31:36.858126 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 9/13] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 10:31:36 2022] DELETE /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:31:36.873681 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-11e6efa9-bfda-4740-987c-a57151673426 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] Calling method '.version_select at 0x7f1c5966e040>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:36.991993 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-11e6efa9-bfda-4740-987c-a57151673426 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c" status: 200 len: 353 microversion: 2.1 time: 0.131572 Feb 28 10:31:36.992553 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 10/14] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:31:36 2022] GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:31:38.006226 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-832c1ef0-ad60-4e9d-ae55-62630bc18702 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] Calling method '.version_select at 0x7f1c5905e8b0>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:38.066142 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-832c1ef0-ad60-4e9d-ae55-62630bc18702 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] HTTP exception thrown: Volume 6df8224d-3910-4b53-92fa-58e4c574616c could not be found. Feb 28 10:31:38.067075 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-832c1ef0-ad60-4e9d-ae55-62630bc18702 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] Returning 404 to user: Volume 6df8224d-3910-4b53-92fa-58e4c574616c could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:31:38.068729 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-832c1ef0-ad60-4e9d-ae55-62630bc18702 tempest-VolumesGetTestJSON-1121859739 tempest-VolumesGetTestJSON-1121859739-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c" status: 404 len: 109 microversion: 2.1 time: 0.066508 Feb 28 10:31:38.069581 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 11/15] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:31:38 2022] GET /compute/v2.1/os-volumes/6df8224d-3910-4b53-92fa-58e4c574616c => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 10:31:38.491055 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Flavor limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:31:38.492133 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Image limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:31:38.492948 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Flavor pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:31:38.493548 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Image pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:31:38.494294 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:31:38.539177 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:38.539839 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:38.541407 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:38.542111 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:38.603265 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Getting quotas for project 16ab7d83969f4e2ea219ab1eb98cf29d. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:31:38.616154 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Getting quotas for user 15ea80a65cbe4394bb9c7d3b73287655 and project 16ab7d83969f4e2ea219ab1eb98cf29d. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:31:38.634481 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Going to run 1 instances... {{(pid=123152) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:31:38.639714 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:31:38.790308 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-42af16a3-ff64-4c56-92c6-dc4e3b9cf6cf tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.912403 Feb 28 10:31:38.792420 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 5/16] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:31:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:31:38.803502 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b6c077e1-2f49-467a-b47e-bbea9102a51e tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:38.804516 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b6c077e1-2f49-467a-b47e-bbea9102a51e tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:39.130126 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b6c077e1-2f49-467a-b47e-bbea9102a51e tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:39.169941 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b6c077e1-2f49-467a-b47e-bbea9102a51e tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1214 microversion: 2.1 time: 0.370902 Feb 28 10:31:39.176598 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 12/17] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:38 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1214 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:40.188327 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-42cef093-9c20-426c-9050-8b5345ccd5ef tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:40.189330 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-42cef093-9c20-426c-9050-8b5345ccd5ef tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:40.405077 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-42cef093-9c20-426c-9050-8b5345ccd5ef tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:40.452267 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-42cef093-9c20-426c-9050-8b5345ccd5ef tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1214 microversion: 2.1 time: 0.264184 Feb 28 10:31:40.454157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 6/18] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:40 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:41.472654 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-58ab7951-6d6f-401d-a524-31a223f53ec6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:41.473376 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-58ab7951-6d6f-401d-a524-31a223f53ec6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:41.485440 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-58ab7951-6d6f-401d-a524-31a223f53ec6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:41.491637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-58ab7951-6d6f-401d-a524-31a223f53ec6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:41.494813 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-58ab7951-6d6f-401d-a524-31a223f53ec6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:41.501310 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-58ab7951-6d6f-401d-a524-31a223f53ec6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:41.861764 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-58ab7951-6d6f-401d-a524-31a223f53ec6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:41.879612 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-58ab7951-6d6f-401d-a524-31a223f53ec6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1210 microversion: 2.1 time: 0.411947 Feb 28 10:31:41.880850 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 13/19] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:41 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1210 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:42.490899 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-611851161", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:42.619067 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.network.neutron [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] validate_networks() for [('7133a7a4-f128-4749-9f5a-21513ed66246', None, None, None, None, None)] {{(pid=123152) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:31:42.899995 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9550e803-b4f3-4443-9708-792fd8921191 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:42.902762 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9550e803-b4f3-4443-9708-792fd8921191 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:42.922755 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9550e803-b4f3-4443-9708-792fd8921191 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:42.923445 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9550e803-b4f3-4443-9708-792fd8921191 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:42.926225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9550e803-b4f3-4443-9708-792fd8921191 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:42.926866 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9550e803-b4f3-4443-9708-792fd8921191 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:43.122687 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9550e803-b4f3-4443-9708-792fd8921191 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:43.132138 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9550e803-b4f3-4443-9708-792fd8921191 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1272 microversion: 2.1 time: 0.238312 Feb 28 10:31:43.145229 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 14/20] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:42 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:31:44.152980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-98255e31-d7d8-4c3a-97ac-8a6ba2860fca tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:44.153683 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-98255e31-d7d8-4c3a-97ac-8a6ba2860fca tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:44.168568 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-98255e31-d7d8-4c3a-97ac-8a6ba2860fca tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:44.169025 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-98255e31-d7d8-4c3a-97ac-8a6ba2860fca tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:44.169823 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-98255e31-d7d8-4c3a-97ac-8a6ba2860fca tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:44.170262 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-98255e31-d7d8-4c3a-97ac-8a6ba2860fca tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:44.355510 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-98255e31-d7d8-4c3a-97ac-8a6ba2860fca tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:44.369155 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-98255e31-d7d8-4c3a-97ac-8a6ba2860fca tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1272 microversion: 2.1 time: 0.223095 Feb 28 10:31:44.369705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 15/21] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:44 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:45.386559 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ab112f39-71fd-46f7-aa14-ae4426c1e5f4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:45.387853 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ab112f39-71fd-46f7-aa14-ae4426c1e5f4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:45.408626 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ab112f39-71fd-46f7-aa14-ae4426c1e5f4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:45.413658 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ab112f39-71fd-46f7-aa14-ae4426c1e5f4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:45.414652 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ab112f39-71fd-46f7-aa14-ae4426c1e5f4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:45.415085 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ab112f39-71fd-46f7-aa14-ae4426c1e5f4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:45.698364 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ab112f39-71fd-46f7-aa14-ae4426c1e5f4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:45.707839 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ab112f39-71fd-46f7-aa14-ae4426c1e5f4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1272 microversion: 2.1 time: 0.325762 Feb 28 10:31:45.721667 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 16/22] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:45 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1272 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:45.934040 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Flavor limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:31:45.934656 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Image limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:31:45.935149 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Flavor pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:31:45.935667 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Image pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:31:45.936186 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:31:45.955247 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:45.963020 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:45.965103 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:45.973279 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:46.064231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Getting quotas for project b77d7fba24894206bc824b8dd499e696. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:31:46.069614 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Getting quotas for user 28641197fb9b472dbe0aecd4dac3f4f3 and project b77d7fba24894206bc824b8dd499e696. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:31:46.086371 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Going to run 1 instances... {{(pid=123152) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:31:46.090627 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:31:46.243801 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-061356d9-8f40-4c3b-aaa6-ccbcaa84803f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.439708 Feb 28 10:31:46.246668 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 7/23] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:31:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 4444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 28 10:31:46.254480 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-74b30a17-05e6-48ae-87be-d4defb1eba77 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:46.258752 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-74b30a17-05e6-48ae-87be-d4defb1eba77 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:46.620026 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-74b30a17-05e6-48ae-87be-d4defb1eba77 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:46.642095 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-74b30a17-05e6-48ae-87be-d4defb1eba77 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1221 microversion: 2.1 time: 0.389437 Feb 28 10:31:46.644608 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 8/24] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:46 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1221 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:46.736173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-79c6ad84-dbde-4b7d-a76f-83311be1936d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:46.737204 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-79c6ad84-dbde-4b7d-a76f-83311be1936d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:46.753532 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-79c6ad84-dbde-4b7d-a76f-83311be1936d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:46.757606 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ab2f5fdb-6cff-43c0-be43-1b86ac7feccb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'create', calling method: .version_select at 0x7f1c5dcd10d0>, body: {"keypair": {"name": "tempest-keypair-1296032570"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:46.759135 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-79c6ad84-dbde-4b7d-a76f-83311be1936d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:46.766941 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-79c6ad84-dbde-4b7d-a76f-83311be1936d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:46.767619 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-79c6ad84-dbde-4b7d-a76f-83311be1936d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:47.037912 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-ab2f5fdb-6cff-43c0-be43-1b86ac7feccb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for project 003233ff59254fa88847f9adc1437df3. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:31:47.074440 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-ab2f5fdb-6cff-43c0-be43-1b86ac7feccb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for user da9524bba20140f694ac7cd6e8f37038 and project 003233ff59254fa88847f9adc1437df3. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:31:48.184164 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-ab2f5fdb-6cff-43c0-be43-1b86ac7feccb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for project 003233ff59254fa88847f9adc1437df3. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:31:48.191017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-ab2f5fdb-6cff-43c0-be43-1b86ac7feccb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for user da9524bba20140f694ac7cd6e8f37038 and project 003233ff59254fa88847f9adc1437df3. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:31:48.248206 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ab2f5fdb-6cff-43c0-be43-1b86ac7feccb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.061846 Feb 28 10:31:48.251700 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 17/25] 10.222.0.21 () {62 vars in 1198 bytes} [Mon Feb 28 10:31:46 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2066 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 28 10:31:48.268448 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-811515329", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:48.356414 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-79c6ad84-dbde-4b7d-a76f-83311be1936d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:48.438412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-79c6ad84-dbde-4b7d-a76f-83311be1936d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 1.706100 Feb 28 10:31:48.463244 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 9/26] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:46 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:48.470923 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-663cd409-59e8-48ce-a7f2-79db8d2ccbc1 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c58683790>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:48.582924 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] validate_networks() for [('7133a7a4-f128-4749-9f5a-21513ed66246', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:31:48.648243 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-663cd409-59e8-48ce-a7f2-79db8d2ccbc1 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/aaa7f866-d438-4985-af3c-de5a32e3aaa5" status: 200 len: 350 microversion: 2.1 time: 0.182813 Feb 28 10:31:48.649566 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 10/27] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:31:48 2022] GET /compute/v2.1/os-volumes/aaa7f866-d438-4985-af3c-de5a32e3aaa5 => generated 350 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:31:49.481822 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e19e100f-49fa-4695-9fc5-128a35dc9bb5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:49.483298 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e19e100f-49fa-4695-9fc5-128a35dc9bb5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:49.509519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e19e100f-49fa-4695-9fc5-128a35dc9bb5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:49.510539 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e19e100f-49fa-4695-9fc5-128a35dc9bb5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:49.521330 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e19e100f-49fa-4695-9fc5-128a35dc9bb5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:49.521907 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e19e100f-49fa-4695-9fc5-128a35dc9bb5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:52.221752 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e19e100f-49fa-4695-9fc5-128a35dc9bb5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:52.237910 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e19e100f-49fa-4695-9fc5-128a35dc9bb5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 2.761096 Feb 28 10:31:52.255780 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 11/28] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:49 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 2779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:52.263361 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c0fdec54-e693-4db7-8a27-38c2ba9b59a3 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c58683f70>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:52.333100 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c0fdec54-e693-4db7-8a27-38c2ba9b59a3 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/84c9a9ea-d10f-4d70-bfe6-a9058acc1b34" status: 200 len: 351 microversion: 2.1 time: 0.075636 Feb 28 10:31:52.347004 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 12/29] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:31:52 2022] GET /compute/v2.1/os-volumes/84c9a9ea-d10f-4d70-bfe6-a9058acc1b34 => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:31:53.232829 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:31:53.238102 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:31:53.238931 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:31:53.240800 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:31:53.241441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:31:53.264492 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7da3677b-0657-4091-8e5a-a79a65fe953b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'create', calling method: .version_select at 0x7f1c5868e4c0>, body: {"keypair": {"name": "tempest-keypair-1136948982"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:53.306644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:53.318279 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:53.345121 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:53.345626 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:53.383329 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-7da3677b-0657-4091-8e5a-a79a65fe953b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:31:53.396561 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-7da3677b-0657-4091-8e5a-a79a65fe953b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for user 9f32c16ee62d441d9e5fde2b1ce0afaf and project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:31:53.453658 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Getting quotas for project b77d7fba24894206bc824b8dd499e696. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:31:53.462583 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Getting quotas for user 28641197fb9b472dbe0aecd4dac3f4f3 and project b77d7fba24894206bc824b8dd499e696. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:31:53.478898 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:31:53.483409 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:31:53.623213 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-771857ab-c711-465c-b8c0-95ac3b93e09b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.364836 Feb 28 10:31:53.629498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 18/30] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:31:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 5373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:31:53.648018 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b313f0c2-36ed-4ec5-a363-25e95084c38d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:53.648685 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b313f0c2-36ed-4ec5-a363-25e95084c38d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:53.674348 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b313f0c2-36ed-4ec5-a363-25e95084c38d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:53.675100 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b313f0c2-36ed-4ec5-a363-25e95084c38d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:53.677043 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b313f0c2-36ed-4ec5-a363-25e95084c38d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:53.677500 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b313f0c2-36ed-4ec5-a363-25e95084c38d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:54.225068 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-7da3677b-0657-4091-8e5a-a79a65fe953b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:31:54.232118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-7da3677b-0657-4091-8e5a-a79a65fe953b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for user 9f32c16ee62d441d9e5fde2b1ce0afaf and project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:31:54.303828 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7da3677b-0657-4091-8e5a-a79a65fe953b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.535539 Feb 28 10:31:54.314946 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 13/31] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 10:31:52 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:31:54.331938 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-bc9dc871-1dfe-4085-9611-3eaff354ae8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:54.355552 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-bc9dc871-1dfe-4085-9611-3eaff354ae8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:54.793874 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-bc9dc871-1dfe-4085-9611-3eaff354ae8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:54.801078 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-bc9dc871-1dfe-4085-9611-3eaff354ae8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1221 microversion: 2.1 time: 0.484903 Feb 28 10:31:54.815490 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 14/32] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:54 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1221 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:54.820919 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b6e68afe-23ad-43a5-a6fe-fb6a729954c0 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c586544c0>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:54.924631 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b6e68afe-23ad-43a5-a6fe-fb6a729954c0 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/c14f25c0-4d7b-464b-bd1a-56b021298eef" status: 200 len: 349 microversion: 2.1 time: 0.107234 Feb 28 10:31:54.932230 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 15/33] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:31:54 2022] GET /compute/v2.1/os-volumes/c14f25c0-4d7b-464b-bd1a-56b021298eef => generated 349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:31:54.942077 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-27640754-81b9-4968-a905-1435ab25eb4f tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c5865d1f0>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:55.265328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-27640754-81b9-4968-a905-1435ab25eb4f tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.329702 Feb 28 10:31:55.274647 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 16/34] 10.222.0.21 () {58 vars in 1133 bytes} [Mon Feb 28 10:31:54 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:55.294802 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9efabc09-d05b-49e7-a80b-bc297d336de5 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c5868ea60>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:55.355368 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b313f0c2-36ed-4ec5-a363-25e95084c38d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:55.371033 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b313f0c2-36ed-4ec5-a363-25e95084c38d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 1.735409 Feb 28 10:31:55.407140 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 19/35] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:53 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:55.681691 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9efabc09-d05b-49e7-a80b-bc297d336de5 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.400464 Feb 28 10:31:55.690823 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 17/36] 10.222.0.21 () {58 vars in 1148 bytes} [Mon Feb 28 10:31:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:31:55.695644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b9d45a08-625e-4e64-94c6-0c437734d80e tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c585fb3a0>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:55.822481 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c76c9849-570f-4af4-b904-2129699577fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:55.823427 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c76c9849-570f-4af4-b904-2129699577fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:55.835283 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c76c9849-570f-4af4-b904-2129699577fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:55.836021 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c76c9849-570f-4af4-b904-2129699577fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:55.837030 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c76c9849-570f-4af4-b904-2129699577fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:55.840172 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c76c9849-570f-4af4-b904-2129699577fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:56.031341 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b9d45a08-625e-4e64-94c6-0c437734d80e tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.339800 Feb 28 10:31:56.032498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 20/37] 10.222.0.21 () {58 vars in 1133 bytes} [Mon Feb 28 10:31:55 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:56.045711 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a3c34237-758e-4b93-8ca9-1ac8d56bdd09 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c58619430>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:56.265139 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c76c9849-570f-4af4-b904-2129699577fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:56.274468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c76c9849-570f-4af4-b904-2129699577fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1273 microversion: 2.1 time: 0.455818 Feb 28 10:31:56.277832 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 18/38] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:55 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1273 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:31:56.316609 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a3c34237-758e-4b93-8ca9-1ac8d56bdd09 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.275571 Feb 28 10:31:56.317431 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 21/39] 10.222.0.21 () {58 vars in 1166 bytes} [Mon Feb 28 10:31:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:31:56.334147 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-24c5404e-7454-4421-84a4-61bdf79fcfb7 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c5868e310>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:56.411536 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f9e10765-cc8c-4a47-940f-3d6352b7e3a1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:56.412500 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f9e10765-cc8c-4a47-940f-3d6352b7e3a1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:56.436379 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9e10765-cc8c-4a47-940f-3d6352b7e3a1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:56.444963 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9e10765-cc8c-4a47-940f-3d6352b7e3a1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:56.448872 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9e10765-cc8c-4a47-940f-3d6352b7e3a1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:56.449618 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9e10765-cc8c-4a47-940f-3d6352b7e3a1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:56.614307 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-24c5404e-7454-4421-84a4-61bdf79fcfb7 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.284581 Feb 28 10:31:56.616267 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 19/40] 10.222.0.21 () {58 vars in 1169 bytes} [Mon Feb 28 10:31:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:31:56.631052 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8d408c2e-04d2-4a6e-9694-b44d2b0410f5 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c586548b0>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:56.838402 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8d408c2e-04d2-4a6e-9694-b44d2b0410f5 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.212193 Feb 28 10:31:56.840620 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 20/41] 10.222.0.21 () {58 vars in 1154 bytes} [Mon Feb 28 10:31:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:56.854093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-de247b82-304b-45ad-a293-25502479872d tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c5865dee0>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:57.035224 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-de247b82-304b-45ad-a293-25502479872d tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.184925 Feb 28 10:31:57.036425 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 21/42] 10.222.0.21 () {58 vars in 1187 bytes} [Mon Feb 28 10:31:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:31:57.053523 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-36582661-c3bd-435b-832b-dea4ca8c6de0 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] Calling method '.version_select at 0x7f1c5865d160>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:57.383118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-36582661-c3bd-435b-832b-dea4ca8c6de0 tempest-VolumesTestJSON-1022220834 tempest-VolumesTestJSON-1022220834-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.334399 Feb 28 10:31:57.383694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 22/43] 10.222.0.21 () {58 vars in 1154 bytes} [Mon Feb 28 10:31:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:31:57.388959 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2c816949-849b-4915-aaae-281baeeef909 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:57.389782 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2c816949-849b-4915-aaae-281baeeef909 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:57.424873 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c816949-849b-4915-aaae-281baeeef909 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:57.426202 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c816949-849b-4915-aaae-281baeeef909 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:57.434577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c816949-849b-4915-aaae-281baeeef909 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:57.436192 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c816949-849b-4915-aaae-281baeeef909 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:58.477888 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2c816949-849b-4915-aaae-281baeeef909 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:58.487057 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2c816949-849b-4915-aaae-281baeeef909 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1279 microversion: 2.1 time: 1.102160 Feb 28 10:31:58.496776 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 23/44] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:57 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1279 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:58.663329 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-02dadc2e-d298-42b1-a8a6-5dbcc612e8df req-9bdf97da-a9ed-44c6-9076-e3a6f1ec2ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42df3b45-4c1d-4d70-a36e-1ad74ba36a4e", "tag": "9d3f112a-0650-404c-920f-c6a38ab77372"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:31:58.725045 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-02dadc2e-d298-42b1-a8a6-5dbcc612e8df req-9bdf97da-a9ed-44c6-9076-e3a6f1ec2ec4 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:58.725537 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-02dadc2e-d298-42b1-a8a6-5dbcc612e8df req-9bdf97da-a9ed-44c6-9076-e3a6f1ec2ec4 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:58.869504 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-02dadc2e-d298-42b1-a8a6-5dbcc612e8df req-9bdf97da-a9ed-44c6-9076-e3a6f1ec2ec4 service nova] Creating event network-changed:9d3f112a-0650-404c-920f-c6a38ab77372 for instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e on hv-cinder-maste Feb 28 10:31:58.870969 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-02dadc2e-d298-42b1-a8a6-5dbcc612e8df req-9bdf97da-a9ed-44c6-9076-e3a6f1ec2ec4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123152) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 28 10:31:58.872394 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d467560e-2516-49be-a7f5-385cdeed759f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:58.883271 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d467560e-2516-49be-a7f5-385cdeed759f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:58.884757 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d467560e-2516-49be-a7f5-385cdeed759f None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:58.885531 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d467560e-2516-49be-a7f5-385cdeed759f None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:58.942267 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.compute.rpcapi [None req-d467560e-2516-49be-a7f5-385cdeed759f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 28 10:31:58.943467 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d467560e-2516-49be-a7f5-385cdeed759f None None] Releasing lock "compute-rpcapi-router" {{(pid=123152) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 28 10:31:58.966582 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f9e10765-cc8c-4a47-940f-3d6352b7e3a1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:58.982170 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f9e10765-cc8c-4a47-940f-3d6352b7e3a1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 2.574634 Feb 28 10:31:58.985174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 22/45] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:56 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 2579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:31:58.985495 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d467560e-2516-49be-a7f5-385cdeed759f None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485190 Feb 28 10:31:58.987132 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 24/46] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:31:59.514708 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0d04c6a7-6567-43c1-9055-ea71bb246c08 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:31:59.516225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0d04c6a7-6567-43c1-9055-ea71bb246c08 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:31:59.531543 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0d04c6a7-6567-43c1-9055-ea71bb246c08 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:59.532731 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0d04c6a7-6567-43c1-9055-ea71bb246c08 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:59.533774 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0d04c6a7-6567-43c1-9055-ea71bb246c08 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:31:59.534560 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0d04c6a7-6567-43c1-9055-ea71bb246c08 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:31:59.877911 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0d04c6a7-6567-43c1-9055-ea71bb246c08 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:31:59.893280 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0d04c6a7-6567-43c1-9055-ea71bb246c08 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1279 microversion: 2.1 time: 0.383511 Feb 28 10:31:59.897948 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 23/47] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:59 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1279 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:31:59.947647 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-945984800", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3e00203-bdaa-4ba7-b433-d6d5ad5222b3"}], "security_groups": [{"name": "tempest-securitygroup--1184799683"}], "key_name": "tempest-keypair-1296032570", "user_data": "}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:00.000849 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0fbc21c7-f3f7-451e-9917-2700297ca58d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:00.002340 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0fbc21c7-f3f7-451e-9917-2700297ca58d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:00.010259 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0fbc21c7-f3f7-451e-9917-2700297ca58d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:00.012317 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0fbc21c7-f3f7-451e-9917-2700297ca58d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:00.016392 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0fbc21c7-f3f7-451e-9917-2700297ca58d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:00.018435 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0fbc21c7-f3f7-451e-9917-2700297ca58d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:00.895310 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.network.neutron [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] validate_networks() for [('a3e00203-bdaa-4ba7-b433-d6d5ad5222b3', None, None, None, None, None)] {{(pid=123152) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:32:01.333016 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0fbc21c7-f3f7-451e-9917-2700297ca58d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:01.343562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0fbc21c7-f3f7-451e-9917-2700297ca58d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 1.345785 Feb 28 10:32:01.346348 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 24/48] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:31:59 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:01.677815 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-838d802e-5374-46b2-b5d0-ff8cfdb6f3a4 req-b5a59232-0c91-4cc3-8ada-920427d9f43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1560b32-2ab2-4234-aeca-5cbe2d745915", "tag": "b4a656dd-70b4-452d-a3c9-90978f7d0dca"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:01.709043 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-838d802e-5374-46b2-b5d0-ff8cfdb6f3a4 req-b5a59232-0c91-4cc3-8ada-920427d9f43a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:01.710001 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-838d802e-5374-46b2-b5d0-ff8cfdb6f3a4 req-b5a59232-0c91-4cc3-8ada-920427d9f43a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:01.736464 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-838d802e-5374-46b2-b5d0-ff8cfdb6f3a4 req-b5a59232-0c91-4cc3-8ada-920427d9f43a service nova] Creating event network-changed:b4a656dd-70b4-452d-a3c9-90978f7d0dca for instance e1560b32-2ab2-4234-aeca-5cbe2d745915 on hv-cinder-maste Feb 28 10:32:01.737446 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-838d802e-5374-46b2-b5d0-ff8cfdb6f3a4 req-b5a59232-0c91-4cc3-8ada-920427d9f43a service nova] Acquired lock "compute-rpcapi-router" {{(pid=123151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 28 10:32:01.738644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4ef6eb36-1463-464c-92a1-ff5bd5af03c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:01.739147 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4ef6eb36-1463-464c-92a1-ff5bd5af03c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:01.740298 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4ef6eb36-1463-464c-92a1-ff5bd5af03c1 None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:01.742061 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4ef6eb36-1463-464c-92a1-ff5bd5af03c1 None None] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:01.752895 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.compute.rpcapi [None req-4ef6eb36-1463-464c-92a1-ff5bd5af03c1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 28 10:32:01.753774 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4ef6eb36-1463-464c-92a1-ff5bd5af03c1 None None] Releasing lock "compute-rpcapi-router" {{(pid=123151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 28 10:32:01.778083 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4ef6eb36-1463-464c-92a1-ff5bd5af03c1 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428594 Feb 28 10:32:01.778892 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 25/49] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:01.785923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4113b601-699e-4aec-b433-577b01b03c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:01.786676 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4113b601-699e-4aec-b433-577b01b03c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:01.795282 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4113b601-699e-4aec-b433-577b01b03c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:01.795761 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4113b601-699e-4aec-b433-577b01b03c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:01.796576 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4113b601-699e-4aec-b433-577b01b03c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:01.797026 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4113b601-699e-4aec-b433-577b01b03c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:02.705060 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4113b601-699e-4aec-b433-577b01b03c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:02.727322 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4113b601-699e-4aec-b433-577b01b03c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.944057 Feb 28 10:32:02.728426 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 26/50] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:01 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:02.744486 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2108403421", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8493f9b-90f0-45ae-88f1-58848e2a93be"}], "security_groups": [{"name": "tempest-securitygroup--304782941"}], "key_name": "tempest-keypair-1136948982", "user_data": "}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:02.899091 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Flavor limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:32:02.899570 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Image limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:32:02.900158 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Flavor pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:32:02.900575 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Image pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:32:02.901002 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:32:02.927978 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:02.928447 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:02.929283 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:02.929749 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:02.972860 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for project 003233ff59254fa88847f9adc1437df3. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:32:02.982436 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for user da9524bba20140f694ac7cd6e8f37038 and project 003233ff59254fa88847f9adc1437df3. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:32:03.003895 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Going to run 1 instances... {{(pid=123152) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:32:03.008625 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:32:03.033749 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] validate_networks() for [('f8493f9b-90f0-45ae-88f1-58848e2a93be', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:32:03.076870 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f7002eb0-d9e5-4f79-a386-cf003a39a743 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.141259 Feb 28 10:32:03.083234 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 25/51] 10.222.0.21 () {62 vars in 1187 bytes} [Mon Feb 28 10:31:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3144 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 28 10:32:03.087680 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-81aaaa3d-d4f1-467f-ab92-7dfd16b7fea8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:03.099484 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-81aaaa3d-d4f1-467f-ab92-7dfd16b7fea8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:03.125715 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-81aaaa3d-d4f1-467f-ab92-7dfd16b7fea8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:03.126197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-81aaaa3d-d4f1-467f-ab92-7dfd16b7fea8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:03.127552 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-81aaaa3d-d4f1-467f-ab92-7dfd16b7fea8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:03.128923 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-81aaaa3d-d4f1-467f-ab92-7dfd16b7fea8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:03.738147 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-81aaaa3d-d4f1-467f-ab92-7dfd16b7fea8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:03.746033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-81aaaa3d-d4f1-467f-ab92-7dfd16b7fea8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.666419 Feb 28 10:32:03.764991 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 26/52] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:03 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:03.771933 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:03.772556 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:03.794579 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:03.795104 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:03.795955 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:03.808603 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:04.006543 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:04.019307 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:04.021514 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:04.023732 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6f2651e0-cbc4-45bb-bf4a-3cd9bf03ad99 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1285 microversion: 2.20 time: 0.257197 Feb 28 10:32:04.024471 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 27/53] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:03 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:04.032092 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-022caf89-b457-49b0-9123-1b2b95df0b74 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:04.033690 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-022caf89-b457-49b0-9123-1b2b95df0b74 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:04.041061 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-022caf89-b457-49b0-9123-1b2b95df0b74 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:04.041517 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-022caf89-b457-49b0-9123-1b2b95df0b74 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:04.042626 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-022caf89-b457-49b0-9123-1b2b95df0b74 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:04.043082 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-022caf89-b457-49b0-9123-1b2b95df0b74 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:04.111012 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:32:04.111548 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:32:04.112081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:32:04.112586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:32:04.113269 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:32:04.127944 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:04.128648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:04.130637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:04.131306 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:04.155347 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:32:04.160795 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for user 9f32c16ee62d441d9e5fde2b1ce0afaf and project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:32:04.175252 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:32:04.177832 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:32:04.213927 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-022caf89-b457-49b0-9123-1b2b95df0b74 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:04.223928 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-022caf89-b457-49b0-9123-1b2b95df0b74 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.197507 Feb 28 10:32:04.234563 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 28/54] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:04 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:04.240086 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-aa23d89b-806f-4db5-ab8b-bafe0d037898 req-b3d07637-604e-4eb2-b296-5f5e6ec1ec3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7de27a-2095-46ac-ade5-992422ccbb4e", "tag": "a59d6bed-3809-43c1-b057-c4e3bf30676c"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:04.241433 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f46fedd7-52c1-4381-8ba2-31504e62ac7d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.511559 Feb 28 10:32:04.242082 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 27/55] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:32:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:32:04.256298 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-aa23d89b-806f-4db5-ab8b-bafe0d037898 req-b3d07637-604e-4eb2-b296-5f5e6ec1ec3f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:04.256796 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-aa23d89b-806f-4db5-ab8b-bafe0d037898 req-b3d07637-604e-4eb2-b296-5f5e6ec1ec3f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:04.259648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-03fd9981-7f75-418d-ba09-1bb899c44296 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:04.260276 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-03fd9981-7f75-418d-ba09-1bb899c44296 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:04.274642 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-aa23d89b-806f-4db5-ab8b-bafe0d037898 req-b3d07637-604e-4eb2-b296-5f5e6ec1ec3f service nova] Creating event network-changed:a59d6bed-3809-43c1-b057-c4e3bf30676c for instance ae7de27a-2095-46ac-ade5-992422ccbb4e on hv-cinder-maste Feb 28 10:32:04.281795 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-aa23d89b-806f-4db5-ab8b-bafe0d037898 req-b3d07637-604e-4eb2-b296-5f5e6ec1ec3f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045290 Feb 28 10:32:04.282808 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 29/56] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:04.328648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-03fd9981-7f75-418d-ba09-1bb899c44296 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:04.338212 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-03fd9981-7f75-418d-ba09-1bb899c44296 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1238 microversion: 2.1 time: 0.087048 Feb 28 10:32:04.339838 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 28/57] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:04 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:04.763980 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ab59aded-7df6-4fa6-b46e-12da95e03732 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:04.764697 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ab59aded-7df6-4fa6-b46e-12da95e03732 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:04.770818 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ab59aded-7df6-4fa6-b46e-12da95e03732 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:04.771524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ab59aded-7df6-4fa6-b46e-12da95e03732 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:04.772425 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ab59aded-7df6-4fa6-b46e-12da95e03732 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:04.772976 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ab59aded-7df6-4fa6-b46e-12da95e03732 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:04.925469 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ab59aded-7df6-4fa6-b46e-12da95e03732 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:04.934820 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ab59aded-7df6-4fa6-b46e-12da95e03732 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.175864 Feb 28 10:32:04.941431 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 30/58] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:04 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:05.041150 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:05.041761 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:05.048492 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:05.048943 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:05.049720 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:05.050155 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:05.121891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:05.129920 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:05.131441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:05.132544 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-491c0a76-0475-4d02-8964-af1b45d87b85 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1285 microversion: 2.20 time: 0.095248 Feb 28 10:32:05.133093 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 29/59] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:05 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:05.241528 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ef5d45c5-2e61-4a0a-8454-cb7d9666ba27 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:05.242410 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ef5d45c5-2e61-4a0a-8454-cb7d9666ba27 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:05.249348 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef5d45c5-2e61-4a0a-8454-cb7d9666ba27 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:05.249806 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef5d45c5-2e61-4a0a-8454-cb7d9666ba27 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:05.250747 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef5d45c5-2e61-4a0a-8454-cb7d9666ba27 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:05.251185 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef5d45c5-2e61-4a0a-8454-cb7d9666ba27 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:05.355189 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6044c09d-58ac-43e3-8b68-dafd0a56370e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:05.356658 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6044c09d-58ac-43e3-8b68-dafd0a56370e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:05.362812 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6044c09d-58ac-43e3-8b68-dafd0a56370e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:05.363663 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6044c09d-58ac-43e3-8b68-dafd0a56370e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:05.365295 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6044c09d-58ac-43e3-8b68-dafd0a56370e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:05.365981 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6044c09d-58ac-43e3-8b68-dafd0a56370e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:05.406913 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ef5d45c5-2e61-4a0a-8454-cb7d9666ba27 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:05.417460 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ef5d45c5-2e61-4a0a-8454-cb7d9666ba27 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.180002 Feb 28 10:32:05.418382 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 31/60] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:05 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:05.439214 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6044c09d-58ac-43e3-8b68-dafd0a56370e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:05.447519 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6044c09d-58ac-43e3-8b68-dafd0a56370e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1242 microversion: 2.1 time: 0.096514 Feb 28 10:32:05.448788 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 30/61] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:05 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:05.958397 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-08cdda3a-f4c9-4e31-89a6-f0e0c1f55690 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:05.959619 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-08cdda3a-f4c9-4e31-89a6-f0e0c1f55690 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:05.980393 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-08cdda3a-f4c9-4e31-89a6-f0e0c1f55690 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:05.981171 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-08cdda3a-f4c9-4e31-89a6-f0e0c1f55690 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:05.981677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-08cdda3a-f4c9-4e31-89a6-f0e0c1f55690 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:05.982116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-08cdda3a-f4c9-4e31-89a6-f0e0c1f55690 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:06.152859 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:06.154190 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:06.167606 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:06.170307 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:06.171424 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:06.173738 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:06.496414 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:06.522647 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:06.529432 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:06.532784 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-89f25cae-6835-4803-8e21-cb230c77f207 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1333 microversion: 2.20 time: 0.385185 Feb 28 10:32:06.535040 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 31/62] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:06 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1333 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:32:06.544618 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3b80508c-e560-4da1-bc58-02f3cb177f90 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:06.548694 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3b80508c-e560-4da1-bc58-02f3cb177f90 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:06.564747 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b80508c-e560-4da1-bc58-02f3cb177f90 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:06.568048 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b80508c-e560-4da1-bc58-02f3cb177f90 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:06.569996 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b80508c-e560-4da1-bc58-02f3cb177f90 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:06.570984 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b80508c-e560-4da1-bc58-02f3cb177f90 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:07.476226 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-08cdda3a-f4c9-4e31-89a6-f0e0c1f55690 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:07.506803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-08cdda3a-f4c9-4e31-89a6-f0e0c1f55690 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 1.559710 Feb 28 10:32:07.508637 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 32/63] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:05 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:07.528709 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0601fc11-a155-4087-8d6d-1075cb5a695f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:07.536944 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0601fc11-a155-4087-8d6d-1075cb5a695f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:07.550371 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0601fc11-a155-4087-8d6d-1075cb5a695f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:07.551125 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0601fc11-a155-4087-8d6d-1075cb5a695f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:07.552105 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0601fc11-a155-4087-8d6d-1075cb5a695f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:07.552700 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0601fc11-a155-4087-8d6d-1075cb5a695f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:07.554114 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3b80508c-e560-4da1-bc58-02f3cb177f90 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:07.595093 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3b80508c-e560-4da1-bc58-02f3cb177f90 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 1.058069 Feb 28 10:32:07.595706 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 32/64] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:06 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:07.643363 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:07.644450 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:07.680901 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:07.681405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:07.682416 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:07.684005 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:07.725642 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0601fc11-a155-4087-8d6d-1075cb5a695f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:07.737162 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0601fc11-a155-4087-8d6d-1075cb5a695f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1296 microversion: 2.1 time: 0.212035 Feb 28 10:32:07.738632 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 33/65] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:07 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1296 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:07.878623 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:07.892540 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:07.899661 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:07.901017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3d03ad79-0380-42cb-81da-010a655b41a0 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1339 microversion: 2.20 time: 0.288843 Feb 28 10:32:07.904498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 33/66] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:07 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1339 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:08.542914 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ac4c46a0-f2fe-46a9-8d87-12e0ea03a9fc tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:08.543600 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ac4c46a0-f2fe-46a9-8d87-12e0ea03a9fc tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:08.562268 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac4c46a0-f2fe-46a9-8d87-12e0ea03a9fc tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:08.562750 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac4c46a0-f2fe-46a9-8d87-12e0ea03a9fc tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:08.563558 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac4c46a0-f2fe-46a9-8d87-12e0ea03a9fc tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:08.564002 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac4c46a0-f2fe-46a9-8d87-12e0ea03a9fc tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:08.612348 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-52cd9f3a-6d9e-41e4-9b23-b0644125f689 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:08.612968 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-52cd9f3a-6d9e-41e4-9b23-b0644125f689 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:08.625618 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-52cd9f3a-6d9e-41e4-9b23-b0644125f689 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:08.626238 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-52cd9f3a-6d9e-41e4-9b23-b0644125f689 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:08.627226 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-52cd9f3a-6d9e-41e4-9b23-b0644125f689 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:08.627822 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-52cd9f3a-6d9e-41e4-9b23-b0644125f689 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:09.168360 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ac4c46a0-f2fe-46a9-8d87-12e0ea03a9fc tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:09.179673 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ac4c46a0-f2fe-46a9-8d87-12e0ea03a9fc tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.642932 Feb 28 10:32:09.180608 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 34/67] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:08 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:09.193986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-28191623-a957-4fa3-961c-52d9e4db279e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:09.201224 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-52cd9f3a-6d9e-41e4-9b23-b0644125f689 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:09.209985 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-28191623-a957-4fa3-961c-52d9e4db279e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:09.216412 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-52cd9f3a-6d9e-41e4-9b23-b0644125f689 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.608248 Feb 28 10:32:09.226168 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 34/68] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:08 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:09.238076 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-28191623-a957-4fa3-961c-52d9e4db279e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:09.238543 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-28191623-a957-4fa3-961c-52d9e4db279e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:09.239407 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-28191623-a957-4fa3-961c-52d9e4db279e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:09.239853 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-28191623-a957-4fa3-961c-52d9e4db279e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:09.244161 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:09.244784 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:09.262015 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:09.267428 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:09.277754 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:09.279589 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:10.366200 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-28191623-a957-4fa3-961c-52d9e4db279e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:10.382557 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-28191623-a957-4fa3-961c-52d9e4db279e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 1.200463 Feb 28 10:32:10.396208 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 35/69] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:09 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:10.399564 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-de3f32c6-293d-4697-a082-034da78ad068 req-3943a6c6-e187-4e4b-b49f-e2a1229b5201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ead279e-e2e9-4312-a47a-fbec064ce99b", "tag": "76aed61f-8cd7-4455-a163-d78d7f320a35"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:10.402811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:10.411726 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-de3f32c6-293d-4697-a082-034da78ad068 req-3943a6c6-e187-4e4b-b49f-e2a1229b5201 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:10.412408 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-de3f32c6-293d-4697-a082-034da78ad068 req-3943a6c6-e187-4e4b-b49f-e2a1229b5201 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:10.418699 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:10.420894 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:10.426339 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9d9a6d9b-502d-4862-a450-28a2b98a0eed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 1.199613 Feb 28 10:32:10.429686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 35/70] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:09 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:10.444162 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-de3f32c6-293d-4697-a082-034da78ad068 req-3943a6c6-e187-4e4b-b49f-e2a1229b5201 service nova] Creating event network-changed:76aed61f-8cd7-4455-a163-d78d7f320a35 for instance 1ead279e-e2e9-4312-a47a-fbec064ce99b on hv-cinder-maste Feb 28 10:32:10.447198 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-47c2053e-531e-4e4f-8c57-48c6dab59460 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:10.450903 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-47c2053e-531e-4e4f-8c57-48c6dab59460 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:10.453553 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-de3f32c6-293d-4697-a082-034da78ad068 req-3943a6c6-e187-4e4b-b49f-e2a1229b5201 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058511 Feb 28 10:32:10.454239 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 36/71] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:10.461642 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-47c2053e-531e-4e4f-8c57-48c6dab59460 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:10.465719 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-47c2053e-531e-4e4f-8c57-48c6dab59460 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:10.466756 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-47c2053e-531e-4e4f-8c57-48c6dab59460 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:10.467295 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-47c2053e-531e-4e4f-8c57-48c6dab59460 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:10.469367 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f8a4bf8c-8f2d-4a92-b379-0dad0324706c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:10.471619 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f8a4bf8c-8f2d-4a92-b379-0dad0324706c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:10.482406 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf8c-8f2d-4a92-b379-0dad0324706c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:10.483158 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf8c-8f2d-4a92-b379-0dad0324706c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:10.484113 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf8c-8f2d-4a92-b379-0dad0324706c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:10.484697 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf8c-8f2d-4a92-b379-0dad0324706c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:10.822349 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-47c2053e-531e-4e4f-8c57-48c6dab59460 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:10.832293 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-47c2053e-531e-4e4f-8c57-48c6dab59460 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.401103 Feb 28 10:32:10.832886 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 36/72] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:10 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:10.875873 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f8a4bf8c-8f2d-4a92-b379-0dad0324706c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:10.884613 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f8a4bf8c-8f2d-4a92-b379-0dad0324706c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.422539 Feb 28 10:32:10.885521 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 37/73] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:10 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:11.259344 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-ffe68ca5-4c64-4231-b929-5dd7c53232ff req-3e1bb2cf-2c92-47cc-8d79-e745635db301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42df3b45-4c1d-4d70-a36e-1ad74ba36a4e", "name": "network-vif-plugged", "status": "completed", "tag": "9d3f112a-0650-404c-920f-c6a38ab77372"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:11.271704 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-d2c38300-a70c-4c40-b0ac-5fd79b7d0eac req-341ef417-e1c9-4fcd-ad9d-d92659b25b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb676a4-94b3-4550-8eb3-b12a16f6f3ec", "tag": "b1a42156-5d5f-4727-a2fd-ca0b2cece4af"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:11.291321 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-d2c38300-a70c-4c40-b0ac-5fd79b7d0eac req-341ef417-e1c9-4fcd-ad9d-d92659b25b81 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.291910 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-d2c38300-a70c-4c40-b0ac-5fd79b7d0eac req-341ef417-e1c9-4fcd-ad9d-d92659b25b81 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:11.294255 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-ffe68ca5-4c64-4231-b929-5dd7c53232ff req-3e1bb2cf-2c92-47cc-8d79-e745635db301 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.295341 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-ffe68ca5-4c64-4231-b929-5dd7c53232ff req-3e1bb2cf-2c92-47cc-8d79-e745635db301 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:11.315491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-d2c38300-a70c-4c40-b0ac-5fd79b7d0eac req-341ef417-e1c9-4fcd-ad9d-d92659b25b81 service nova] Creating event network-changed:b1a42156-5d5f-4727-a2fd-ca0b2cece4af for instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec on hv-cinder-maste Feb 28 10:32:11.326856 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-d2c38300-a70c-4c40-b0ac-5fd79b7d0eac req-341ef417-e1c9-4fcd-ad9d-d92659b25b81 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057190 Feb 28 10:32:11.328850 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 38/74] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:32:11.332706 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-ffe68ca5-4c64-4231-b929-5dd7c53232ff req-3e1bb2cf-2c92-47cc-8d79-e745635db301 service nova] Creating event network-vif-plugged:9d3f112a-0650-404c-920f-c6a38ab77372 for instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e on hv-cinder-maste Feb 28 10:32:11.345335 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-ffe68ca5-4c64-4231-b929-5dd7c53232ff req-3e1bb2cf-2c92-47cc-8d79-e745635db301 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.506880 Feb 28 10:32:11.346644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 37/75] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:11.407949 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7157e4b1-68af-4d7c-bfe5-a51293ff2b9d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:11.407949 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7157e4b1-68af-4d7c-bfe5-a51293ff2b9d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:11.416375 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7157e4b1-68af-4d7c-bfe5-a51293ff2b9d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.416375 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7157e4b1-68af-4d7c-bfe5-a51293ff2b9d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:11.417208 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7157e4b1-68af-4d7c-bfe5-a51293ff2b9d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.417849 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7157e4b1-68af-4d7c-bfe5-a51293ff2b9d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:11.450009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:11.450745 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:11.460637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.461375 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:11.462356 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.463023 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:11.709421 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7157e4b1-68af-4d7c-bfe5-a51293ff2b9d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:11.719027 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7157e4b1-68af-4d7c-bfe5-a51293ff2b9d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.321867 Feb 28 10:32:11.720059 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 39/76] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:11 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:11.731996 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:11.743226 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:11.744813 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:11.746102 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-dd04ceb7-5d16-4820-923d-140c00a4e851 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.301940 Feb 28 10:32:11.746694 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 38/77] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:11 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:11.855290 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-48accada-b8e1-48c9-9917-05861fa3aa44 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:11.856145 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-48accada-b8e1-48c9-9917-05861fa3aa44 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:11.864356 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48accada-b8e1-48c9-9917-05861fa3aa44 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.864817 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48accada-b8e1-48c9-9917-05861fa3aa44 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:11.865824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48accada-b8e1-48c9-9917-05861fa3aa44 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.866477 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48accada-b8e1-48c9-9917-05861fa3aa44 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:11.904443 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-daf6fe9d-7cae-4faa-bd95-cfe14826fb34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:11.905659 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-daf6fe9d-7cae-4faa-bd95-cfe14826fb34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:11.912281 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-daf6fe9d-7cae-4faa-bd95-cfe14826fb34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.912957 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-daf6fe9d-7cae-4faa-bd95-cfe14826fb34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:11.914056 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-daf6fe9d-7cae-4faa-bd95-cfe14826fb34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:11.914727 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-daf6fe9d-7cae-4faa-bd95-cfe14826fb34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:12.099871 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-48accada-b8e1-48c9-9917-05861fa3aa44 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:12.112480 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-48accada-b8e1-48c9-9917-05861fa3aa44 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.265437 Feb 28 10:32:12.113776 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 40/78] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:11 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:12.165450 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-daf6fe9d-7cae-4faa-bd95-cfe14826fb34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:12.177136 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-daf6fe9d-7cae-4faa-bd95-cfe14826fb34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.275941 Feb 28 10:32:12.177136 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 39/79] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:11 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:12.736778 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-720d4c3a-d22e-48f0-8bad-b0c2dfc5b31a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:12.737993 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-720d4c3a-d22e-48f0-8bad-b0c2dfc5b31a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:12.744223 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-720d4c3a-d22e-48f0-8bad-b0c2dfc5b31a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:12.744997 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-720d4c3a-d22e-48f0-8bad-b0c2dfc5b31a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:12.746986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-720d4c3a-d22e-48f0-8bad-b0c2dfc5b31a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:12.747697 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-720d4c3a-d22e-48f0-8bad-b0c2dfc5b31a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:12.767536 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:12.768712 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:12.776691 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:12.777151 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:12.777942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:12.778373 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:13.018858 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-720d4c3a-d22e-48f0-8bad-b0c2dfc5b31a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:13.033228 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-720d4c3a-d22e-48f0-8bad-b0c2dfc5b31a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.300261 Feb 28 10:32:13.044093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 41/80] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:12 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:13.136642 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3fdb72ca-80ed-4d57-819b-cc6c35a81513 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:13.137626 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3fdb72ca-80ed-4d57-819b-cc6c35a81513 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:13.144579 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fdb72ca-80ed-4d57-819b-cc6c35a81513 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:13.145188 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fdb72ca-80ed-4d57-819b-cc6c35a81513 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:13.146196 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fdb72ca-80ed-4d57-819b-cc6c35a81513 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:13.146821 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fdb72ca-80ed-4d57-819b-cc6c35a81513 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:13.190016 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:13.204989 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:13.206818 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:13.207980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2923b3e7-dccd-45b3-a52d-8da2d92fdbc5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.446426 Feb 28 10:32:13.208553 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 40/81] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:12 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:32:13.216804 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-db945997-a9a4-43bc-850e-4542d2391621 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:13.220100 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-db945997-a9a4-43bc-850e-4542d2391621 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:13.227611 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-db945997-a9a4-43bc-850e-4542d2391621 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:13.228072 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-db945997-a9a4-43bc-850e-4542d2391621 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:13.232000 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-db945997-a9a4-43bc-850e-4542d2391621 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:13.232656 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-db945997-a9a4-43bc-850e-4542d2391621 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:13.380234 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3fdb72ca-80ed-4d57-819b-cc6c35a81513 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:13.390131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3fdb72ca-80ed-4d57-819b-cc6c35a81513 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.257671 Feb 28 10:32:13.390949 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 42/82] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:13 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:13.397344 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-86298bab-f72f-4d45-a550-d5b104695d81 req-55553685-a835-4bf5-8521-073ff84c53b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1560b32-2ab2-4234-aeca-5cbe2d745915", "name": "network-vif-plugged", "status": "completed", "tag": "b4a656dd-70b4-452d-a3c9-90978f7d0dca"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:13.412746 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-86298bab-f72f-4d45-a550-d5b104695d81 req-55553685-a835-4bf5-8521-073ff84c53b7 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:13.419429 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-86298bab-f72f-4d45-a550-d5b104695d81 req-55553685-a835-4bf5-8521-073ff84c53b7 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:13.437224 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-86298bab-f72f-4d45-a550-d5b104695d81 req-55553685-a835-4bf5-8521-073ff84c53b7 service nova] Creating event network-vif-plugged:b4a656dd-70b4-452d-a3c9-90978f7d0dca for instance e1560b32-2ab2-4234-aeca-5cbe2d745915 on hv-cinder-maste Feb 28 10:32:13.443474 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-86298bab-f72f-4d45-a550-d5b104695d81 req-55553685-a835-4bf5-8521-073ff84c53b7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050076 Feb 28 10:32:13.445171 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 43/83] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:13.451892 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-db945997-a9a4-43bc-850e-4542d2391621 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:13.459674 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-db945997-a9a4-43bc-850e-4542d2391621 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.249362 Feb 28 10:32:13.460516 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 41/84] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:13 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:14.053493 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2c2a6119-31ff-4d23-9526-39249a589480 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:14.054773 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2c2a6119-31ff-4d23-9526-39249a589480 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:14.077363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c2a6119-31ff-4d23-9526-39249a589480 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:14.077832 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c2a6119-31ff-4d23-9526-39249a589480 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:14.078725 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c2a6119-31ff-4d23-9526-39249a589480 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:14.079180 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c2a6119-31ff-4d23-9526-39249a589480 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:14.225984 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:14.226623 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:14.227563 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2c2a6119-31ff-4d23-9526-39249a589480 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:14.233020 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:14.233473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:14.234263 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:14.234730 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:14.235777 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2c2a6119-31ff-4d23-9526-39249a589480 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.188360 Feb 28 10:32:14.236601 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 44/85] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:14 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:14.380050 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:14.389112 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:14.390945 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:14.392043 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4bb73ae8-2f2c-449e-b6ba-80dd883e8ed6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.169988 Feb 28 10:32:14.392679 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 42/86] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:14 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:32:14.407238 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-06d3e481-b68e-4b3f-9f1b-99fee05c11d5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:14.407857 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-06d3e481-b68e-4b3f-9f1b-99fee05c11d5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:14.413804 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-06d3e481-b68e-4b3f-9f1b-99fee05c11d5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:14.414461 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-06d3e481-b68e-4b3f-9f1b-99fee05c11d5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:14.415276 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-06d3e481-b68e-4b3f-9f1b-99fee05c11d5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:14.415718 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-06d3e481-b68e-4b3f-9f1b-99fee05c11d5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:14.477263 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-aadae238-d664-41df-9f82-24050892bcc5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:14.477913 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-aadae238-d664-41df-9f82-24050892bcc5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:14.484355 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aadae238-d664-41df-9f82-24050892bcc5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:14.484812 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aadae238-d664-41df-9f82-24050892bcc5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:14.485786 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aadae238-d664-41df-9f82-24050892bcc5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:14.486225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aadae238-d664-41df-9f82-24050892bcc5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:14.580563 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-06d3e481-b68e-4b3f-9f1b-99fee05c11d5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:14.588106 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-06d3e481-b68e-4b3f-9f1b-99fee05c11d5 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.185244 Feb 28 10:32:14.589246 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 45/87] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:14 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:14.645265 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-aadae238-d664-41df-9f82-24050892bcc5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:14.653315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-aadae238-d664-41df-9f82-24050892bcc5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.179942 Feb 28 10:32:14.653871 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 43/88] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:14 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:15.253625 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1f968200-ff7b-4aff-8a97-09819f26be82 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:15.254230 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1f968200-ff7b-4aff-8a97-09819f26be82 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:15.260083 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1f968200-ff7b-4aff-8a97-09819f26be82 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:15.261173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1f968200-ff7b-4aff-8a97-09819f26be82 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:15.262098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1f968200-ff7b-4aff-8a97-09819f26be82 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:15.262536 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1f968200-ff7b-4aff-8a97-09819f26be82 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:15.398315 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1f968200-ff7b-4aff-8a97-09819f26be82 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:15.406395 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1f968200-ff7b-4aff-8a97-09819f26be82 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.156530 Feb 28 10:32:15.407904 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 46/89] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:15 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:15.410630 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:15.411294 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:15.417836 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:15.418315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:15.419139 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:15.419583 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:15.560416 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:15.568532 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:15.570350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:15.571343 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8c979974-ff7f-4f24-b868-01be41ce5195 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.164668 Feb 28 10:32:15.571899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 44/90] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:15 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:32:15.605190 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-18aaec8b-d69b-42d9-b0b5-574dbdfd90b8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:15.605811 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-18aaec8b-d69b-42d9-b0b5-574dbdfd90b8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:15.611593 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-18aaec8b-d69b-42d9-b0b5-574dbdfd90b8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:15.612049 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-18aaec8b-d69b-42d9-b0b5-574dbdfd90b8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:15.612865 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-18aaec8b-d69b-42d9-b0b5-574dbdfd90b8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:15.613278 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-18aaec8b-d69b-42d9-b0b5-574dbdfd90b8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:15.669891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2c442cec-8262-45df-8c1a-16a1185e2606 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:15.670513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2c442cec-8262-45df-8c1a-16a1185e2606 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:15.676654 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2c442cec-8262-45df-8c1a-16a1185e2606 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:15.677347 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2c442cec-8262-45df-8c1a-16a1185e2606 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:15.678343 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2c442cec-8262-45df-8c1a-16a1185e2606 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:15.678904 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2c442cec-8262-45df-8c1a-16a1185e2606 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:15.787918 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-18aaec8b-d69b-42d9-b0b5-574dbdfd90b8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:15.809007 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-18aaec8b-d69b-42d9-b0b5-574dbdfd90b8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.207651 Feb 28 10:32:15.819575 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 47/91] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:15 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:16.021659 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2c442cec-8262-45df-8c1a-16a1185e2606 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:16.029230 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2c442cec-8262-45df-8c1a-16a1185e2606 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.363188 Feb 28 10:32:16.029811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 45/92] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:15 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:16.424350 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b805794f-968f-4c7e-8c76-bd89ab3f7bab tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:16.424875 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b805794f-968f-4c7e-8c76-bd89ab3f7bab tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:16.430523 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b805794f-968f-4c7e-8c76-bd89ab3f7bab tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:16.430997 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b805794f-968f-4c7e-8c76-bd89ab3f7bab tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:16.431799 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b805794f-968f-4c7e-8c76-bd89ab3f7bab tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:16.432231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b805794f-968f-4c7e-8c76-bd89ab3f7bab tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:16.565845 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b805794f-968f-4c7e-8c76-bd89ab3f7bab tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:16.573559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b805794f-968f-4c7e-8c76-bd89ab3f7bab tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.152754 Feb 28 10:32:16.574614 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 48/93] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:16 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:16.590451 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:16.591093 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:16.596933 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:16.597381 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:16.598149 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:16.598573 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:16.814000 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:16.827204 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:16.829172 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:16.829587 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4657852e-10c5-4264-b995-b5c9efe84081 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:16.830214 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4657852e-10c5-4264-b995-b5c9efe84081 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:16.831095 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ea258bbe-52c0-42ec-9e7f-332fe5399796 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.245627 Feb 28 10:32:16.831847 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 46/94] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:16 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:16.862797 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4657852e-10c5-4264-b995-b5c9efe84081 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:16.863534 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4657852e-10c5-4264-b995-b5c9efe84081 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:16.864100 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4657852e-10c5-4264-b995-b5c9efe84081 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:16.864540 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4657852e-10c5-4264-b995-b5c9efe84081 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:17.025147 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4657852e-10c5-4264-b995-b5c9efe84081 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:17.035731 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4657852e-10c5-4264-b995-b5c9efe84081 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.212792 Feb 28 10:32:17.036213 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 49/95] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:16 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:17.046198 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a20f7790-3221-450d-8b1d-7f86f0bc18e3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:17.046841 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a20f7790-3221-450d-8b1d-7f86f0bc18e3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:17.053610 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a20f7790-3221-450d-8b1d-7f86f0bc18e3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:17.054346 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a20f7790-3221-450d-8b1d-7f86f0bc18e3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:17.055413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a20f7790-3221-450d-8b1d-7f86f0bc18e3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:17.056169 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a20f7790-3221-450d-8b1d-7f86f0bc18e3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:17.272283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a20f7790-3221-450d-8b1d-7f86f0bc18e3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:17.291456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a20f7790-3221-450d-8b1d-7f86f0bc18e3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.250117 Feb 28 10:32:17.295046 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 47/96] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:17 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:17.591884 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-29bbb999-c7f6-4b7d-9e6a-99d307f13a34 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:17.591884 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-29bbb999-c7f6-4b7d-9e6a-99d307f13a34 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:17.609369 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29bbb999-c7f6-4b7d-9e6a-99d307f13a34 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:17.610007 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29bbb999-c7f6-4b7d-9e6a-99d307f13a34 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:17.611267 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29bbb999-c7f6-4b7d-9e6a-99d307f13a34 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:17.611849 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29bbb999-c7f6-4b7d-9e6a-99d307f13a34 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:17.755386 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-29bbb999-c7f6-4b7d-9e6a-99d307f13a34 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:17.764338 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-29bbb999-c7f6-4b7d-9e6a-99d307f13a34 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.177510 Feb 28 10:32:17.765466 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 50/97] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:17 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:17.849752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:17.850365 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:17.857910 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:17.858366 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:17.859187 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:17.859629 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:18.039911 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:18.047709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:18.049506 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:18.050805 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e102d188-f336-4191-9f25-811792e0bb8a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.204713 Feb 28 10:32:18.051381 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 48/98] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:17 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:18.053684 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-307caf20-0252-4e87-a64b-adb0fb092257 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:18.054405 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-307caf20-0252-4e87-a64b-adb0fb092257 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:18.061527 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-307caf20-0252-4e87-a64b-adb0fb092257 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:18.062131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-307caf20-0252-4e87-a64b-adb0fb092257 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:18.063060 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-307caf20-0252-4e87-a64b-adb0fb092257 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:18.063642 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-307caf20-0252-4e87-a64b-adb0fb092257 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:18.226209 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-307caf20-0252-4e87-a64b-adb0fb092257 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:18.233821 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-307caf20-0252-4e87-a64b-adb0fb092257 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.184279 Feb 28 10:32:18.234269 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 51/99] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:18 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:18.313633 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4638d13b-59b6-4610-a755-0f2b43284366 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:18.314244 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4638d13b-59b6-4610-a755-0f2b43284366 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:18.320080 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4638d13b-59b6-4610-a755-0f2b43284366 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:18.320533 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4638d13b-59b6-4610-a755-0f2b43284366 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:18.321319 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4638d13b-59b6-4610-a755-0f2b43284366 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:18.321759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4638d13b-59b6-4610-a755-0f2b43284366 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:18.454737 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4638d13b-59b6-4610-a755-0f2b43284366 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:18.464715 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4638d13b-59b6-4610-a755-0f2b43284366 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.153748 Feb 28 10:32:18.474501 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 49/100] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:18 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:18.782927 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6e43b4d3-d859-4e97-8b4d-89a1251aadc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:18.783807 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6e43b4d3-d859-4e97-8b4d-89a1251aadc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:18.792540 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e43b4d3-d859-4e97-8b4d-89a1251aadc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:18.793004 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e43b4d3-d859-4e97-8b4d-89a1251aadc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:18.793813 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e43b4d3-d859-4e97-8b4d-89a1251aadc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:18.794257 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e43b4d3-d859-4e97-8b4d-89a1251aadc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:18.996677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6e43b4d3-d859-4e97-8b4d-89a1251aadc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:19.004180 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6e43b4d3-d859-4e97-8b4d-89a1251aadc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.225483 Feb 28 10:32:19.004891 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 52/101] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:18 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:19.069165 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:19.070381 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:19.076849 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:19.077365 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:19.078241 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:19.078788 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:19.224585 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:19.233610 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:19.235290 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:19.236573 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-bb0c47a4-8728-4a78-98a7-2049b463a1b9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.171479 Feb 28 10:32:19.246923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 50/102] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:19 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:19.254303 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-575cdce9-2050-4360-aec7-d45a2018a7d9 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:19.255156 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-575cdce9-2050-4360-aec7-d45a2018a7d9 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:19.261187 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-575cdce9-2050-4360-aec7-d45a2018a7d9 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:19.261640 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-575cdce9-2050-4360-aec7-d45a2018a7d9 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:19.262428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-575cdce9-2050-4360-aec7-d45a2018a7d9 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:19.262965 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-575cdce9-2050-4360-aec7-d45a2018a7d9 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:19.402366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-575cdce9-2050-4360-aec7-d45a2018a7d9 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:19.409530 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-575cdce9-2050-4360-aec7-d45a2018a7d9 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.162498 Feb 28 10:32:19.410088 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 53/103] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:19 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:19.481470 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5cadff92-8dff-455f-8cbe-bb73367f5166 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:19.482084 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5cadff92-8dff-455f-8cbe-bb73367f5166 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:19.489402 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5cadff92-8dff-455f-8cbe-bb73367f5166 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:19.489852 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5cadff92-8dff-455f-8cbe-bb73367f5166 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:19.490682 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5cadff92-8dff-455f-8cbe-bb73367f5166 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:19.491117 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5cadff92-8dff-455f-8cbe-bb73367f5166 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:19.637213 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5cadff92-8dff-455f-8cbe-bb73367f5166 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:19.644429 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5cadff92-8dff-455f-8cbe-bb73367f5166 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.167108 Feb 28 10:32:19.645005 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 51/104] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:19 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:20.021933 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-58e99f4a-f8ed-429d-a488-29b34afd7ab5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:20.022550 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-58e99f4a-f8ed-429d-a488-29b34afd7ab5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:20.028368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-58e99f4a-f8ed-429d-a488-29b34afd7ab5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:20.028821 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-58e99f4a-f8ed-429d-a488-29b34afd7ab5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:20.029640 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-58e99f4a-f8ed-429d-a488-29b34afd7ab5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:20.030077 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-58e99f4a-f8ed-429d-a488-29b34afd7ab5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:20.164714 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-58e99f4a-f8ed-429d-a488-29b34afd7ab5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:20.173407 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-58e99f4a-f8ed-429d-a488-29b34afd7ab5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.155131 Feb 28 10:32:20.173972 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 54/105] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:20 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:20.254522 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:20.255329 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:20.261936 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:20.262397 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:20.263225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:20.263668 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:20.400861 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:20.409543 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:20.411097 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:20.412206 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2d46c7d3-05c6-4af8-aeef-224cc7c79cac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.161626 Feb 28 10:32:20.412752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 52/106] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:20 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:20.426775 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-cbe1bf24-697d-45a3-bd91-f09f80230a1b tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:20.427384 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-cbe1bf24-697d-45a3-bd91-f09f80230a1b tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:20.433451 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbe1bf24-697d-45a3-bd91-f09f80230a1b tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:20.433897 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbe1bf24-697d-45a3-bd91-f09f80230a1b tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:20.434700 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbe1bf24-697d-45a3-bd91-f09f80230a1b tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:20.435140 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbe1bf24-697d-45a3-bd91-f09f80230a1b tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:20.574995 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-cbe1bf24-697d-45a3-bd91-f09f80230a1b tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:20.582500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-cbe1bf24-697d-45a3-bd91-f09f80230a1b tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.159421 Feb 28 10:32:20.583243 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 55/107] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:20 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:20.663733 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4f6f7874-ece4-45f7-b06e-e35323950056 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:20.663733 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4f6f7874-ece4-45f7-b06e-e35323950056 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:20.673240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4f6f7874-ece4-45f7-b06e-e35323950056 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:20.673686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4f6f7874-ece4-45f7-b06e-e35323950056 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:20.674466 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4f6f7874-ece4-45f7-b06e-e35323950056 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:20.674927 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4f6f7874-ece4-45f7-b06e-e35323950056 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:20.813393 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4f6f7874-ece4-45f7-b06e-e35323950056 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:20.820723 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4f6f7874-ece4-45f7-b06e-e35323950056 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.162161 Feb 28 10:32:20.821300 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 53/108] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:20 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:20.923867 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-b1247e48-148a-40ea-8bed-7b0708a8c597 req-304f4e5f-da27-42b9-ac85-956bf45be699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7de27a-2095-46ac-ade5-992422ccbb4e", "name": "network-vif-plugged", "status": "completed", "tag": "a59d6bed-3809-43c1-b057-c4e3bf30676c"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:20.933276 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-b1247e48-148a-40ea-8bed-7b0708a8c597 req-304f4e5f-da27-42b9-ac85-956bf45be699 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:20.933943 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-b1247e48-148a-40ea-8bed-7b0708a8c597 req-304f4e5f-da27-42b9-ac85-956bf45be699 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:20.948810 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-b1247e48-148a-40ea-8bed-7b0708a8c597 req-304f4e5f-da27-42b9-ac85-956bf45be699 service nova] Creating event network-vif-plugged:a59d6bed-3809-43c1-b057-c4e3bf30676c for instance ae7de27a-2095-46ac-ade5-992422ccbb4e on hv-cinder-maste Feb 28 10:32:20.956141 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-b1247e48-148a-40ea-8bed-7b0708a8c597 req-304f4e5f-da27-42b9-ac85-956bf45be699 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038907 Feb 28 10:32:20.956820 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 56/109] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:32:21.190651 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2bc989d6-4aa6-493e-9e0e-129f1ae4c5b0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:21.191270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2bc989d6-4aa6-493e-9e0e-129f1ae4c5b0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:21.197105 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2bc989d6-4aa6-493e-9e0e-129f1ae4c5b0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:21.198304 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2bc989d6-4aa6-493e-9e0e-129f1ae4c5b0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:21.199154 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2bc989d6-4aa6-493e-9e0e-129f1ae4c5b0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:21.199598 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2bc989d6-4aa6-493e-9e0e-129f1ae4c5b0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:21.352372 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2bc989d6-4aa6-493e-9e0e-129f1ae4c5b0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:21.360994 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2bc989d6-4aa6-493e-9e0e-129f1ae4c5b0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.174201 Feb 28 10:32:21.361566 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 54/110] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:21 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:21.430888 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:21.431585 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:21.437718 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:21.438173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:21.439033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:21.439463 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:21.574279 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:21.582108 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:21.583692 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:21.585028 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f9ec85d1-1817-4231-a668-473a2828e1ef tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.158473 Feb 28 10:32:21.585591 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 57/111] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:21 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:32:21.606890 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c6ed5afc-339f-4f44-a99a-0acd45910e34 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:21.608608 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c6ed5afc-339f-4f44-a99a-0acd45910e34 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:21.618021 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c6ed5afc-339f-4f44-a99a-0acd45910e34 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:21.618889 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c6ed5afc-339f-4f44-a99a-0acd45910e34 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:21.620290 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c6ed5afc-339f-4f44-a99a-0acd45910e34 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:21.621397 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c6ed5afc-339f-4f44-a99a-0acd45910e34 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:21.796895 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c6ed5afc-339f-4f44-a99a-0acd45910e34 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:21.804864 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c6ed5afc-339f-4f44-a99a-0acd45910e34 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1314 microversion: 2.1 time: 0.206429 Feb 28 10:32:21.805907 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 55/112] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:21 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:21.838029 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-207b5a62-a545-47c5-96c6-b1cfacc8bffc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:21.838783 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-207b5a62-a545-47c5-96c6-b1cfacc8bffc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:21.845902 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-207b5a62-a545-47c5-96c6-b1cfacc8bffc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:21.846372 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-207b5a62-a545-47c5-96c6-b1cfacc8bffc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:21.847204 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-207b5a62-a545-47c5-96c6-b1cfacc8bffc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:21.847636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-207b5a62-a545-47c5-96c6-b1cfacc8bffc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:21.989341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-207b5a62-a545-47c5-96c6-b1cfacc8bffc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:21.997284 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-207b5a62-a545-47c5-96c6-b1cfacc8bffc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.163754 Feb 28 10:32:21.997849 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 58/113] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:21 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:22.377267 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2d991618-b2c8-477f-bd60-692c5f2c2843 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:22.377977 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2d991618-b2c8-477f-bd60-692c5f2c2843 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:22.384521 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d991618-b2c8-477f-bd60-692c5f2c2843 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:22.385032 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d991618-b2c8-477f-bd60-692c5f2c2843 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:22.385828 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d991618-b2c8-477f-bd60-692c5f2c2843 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:22.387031 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d991618-b2c8-477f-bd60-692c5f2c2843 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:22.532585 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2d991618-b2c8-477f-bd60-692c5f2c2843 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:22.540602 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2d991618-b2c8-477f-bd60-692c5f2c2843 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.167131 Feb 28 10:32:22.541303 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 56/114] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:22 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:22.605000 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:22.606370 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:22.612703 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:22.613157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:22.614127 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:22.614864 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:22.767349 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:22.775397 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:22.776915 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:22.778135 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-62f9400a-eb02-4437-8f1c-6ef20fe447ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.177650 Feb 28 10:32:22.778724 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 59/115] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:22 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:22.821798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-239250a7-f4f1-4acf-9f12-f5d517112ad3 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:22.822413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-239250a7-f4f1-4acf-9f12-f5d517112ad3 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:22.828984 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-239250a7-f4f1-4acf-9f12-f5d517112ad3 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:22.829571 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-239250a7-f4f1-4acf-9f12-f5d517112ad3 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:22.830350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-239250a7-f4f1-4acf-9f12-f5d517112ad3 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:22.830827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-239250a7-f4f1-4acf-9f12-f5d517112ad3 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:22.976919 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-239250a7-f4f1-4acf-9f12-f5d517112ad3 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:22.984433 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-239250a7-f4f1-4acf-9f12-f5d517112ad3 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1501 microversion: 2.1 time: 0.166773 Feb 28 10:32:22.985093 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 57/116] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:22 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:23.013704 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7a0e04ef-c563-47b8-b508-02769ccef972 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:23.014319 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7a0e04ef-c563-47b8-b508-02769ccef972 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:23.020085 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7a0e04ef-c563-47b8-b508-02769ccef972 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:23.020544 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7a0e04ef-c563-47b8-b508-02769ccef972 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:23.021336 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7a0e04ef-c563-47b8-b508-02769ccef972 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:23.021777 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7a0e04ef-c563-47b8-b508-02769ccef972 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:23.164760 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7a0e04ef-c563-47b8-b508-02769ccef972 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:23.175366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7a0e04ef-c563-47b8-b508-02769ccef972 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.165515 Feb 28 10:32:23.175856 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 60/117] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:23 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:23.557481 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-aed2d21f-e653-4c12-926b-a8a09cd94849 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:23.558100 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-aed2d21f-e653-4c12-926b-a8a09cd94849 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:23.564191 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aed2d21f-e653-4c12-926b-a8a09cd94849 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:23.564631 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aed2d21f-e653-4c12-926b-a8a09cd94849 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:23.565413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aed2d21f-e653-4c12-926b-a8a09cd94849 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:23.565846 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aed2d21f-e653-4c12-926b-a8a09cd94849 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:23.764669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-aed2d21f-e653-4c12-926b-a8a09cd94849 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:23.771876 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-aed2d21f-e653-4c12-926b-a8a09cd94849 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.218226 Feb 28 10:32:23.772441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 58/118] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:23 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:23.801324 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:23.801938 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:23.809533 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:23.810103 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:23.811870 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:23.812626 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:24.006704 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:24.015950 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:24.017452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:24.018558 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-caffdcb4-6abe-4c63-92ae-a99d3abd1c54 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.226560 Feb 28 10:32:24.019112 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 61/119] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:23 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:24.193724 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7f8cac6f-ed0d-4d2a-93f9-4bd04f26c7f2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:24.194444 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7f8cac6f-ed0d-4d2a-93f9-4bd04f26c7f2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:24.201504 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7f8cac6f-ed0d-4d2a-93f9-4bd04f26c7f2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:24.202138 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7f8cac6f-ed0d-4d2a-93f9-4bd04f26c7f2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:24.203076 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7f8cac6f-ed0d-4d2a-93f9-4bd04f26c7f2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:24.203616 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7f8cac6f-ed0d-4d2a-93f9-4bd04f26c7f2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:24.365090 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7f8cac6f-ed0d-4d2a-93f9-4bd04f26c7f2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:24.382780 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7f8cac6f-ed0d-4d2a-93f9-4bd04f26c7f2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.193167 Feb 28 10:32:24.383337 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 59/120] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:24 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:24.789241 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-cd9a3c13-52e6-421e-b25d-225744b0fc91 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:24.790300 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-cd9a3c13-52e6-421e-b25d-225744b0fc91 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:24.796236 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd9a3c13-52e6-421e-b25d-225744b0fc91 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:24.796793 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd9a3c13-52e6-421e-b25d-225744b0fc91 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:24.797638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd9a3c13-52e6-421e-b25d-225744b0fc91 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:24.798141 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd9a3c13-52e6-421e-b25d-225744b0fc91 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:24.992010 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-cd9a3c13-52e6-421e-b25d-225744b0fc91 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:25.002872 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-cd9a3c13-52e6-421e-b25d-225744b0fc91 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.217338 Feb 28 10:32:25.003678 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 62/121] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:24 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:25.036776 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:25.037387 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:25.044120 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:25.044770 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:25.045743 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:25.046326 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:25.313432 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:25.324603 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:25.326581 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:25.327718 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e0884451-1dda-4eb2-81bf-b70e5fa4af11 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.294805 Feb 28 10:32:25.328661 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 60/122] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:25 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:25.409933 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0ac14afc-f45a-41e8-b5f8-b5b51dca2919 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:25.410563 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0ac14afc-f45a-41e8-b5f8-b5b51dca2919 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:25.424275 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ac14afc-f45a-41e8-b5f8-b5b51dca2919 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:25.424738 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ac14afc-f45a-41e8-b5f8-b5b51dca2919 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:25.425546 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ac14afc-f45a-41e8-b5f8-b5b51dca2919 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:25.425990 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ac14afc-f45a-41e8-b5f8-b5b51dca2919 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:25.572550 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0ac14afc-f45a-41e8-b5f8-b5b51dca2919 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:25.580562 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0ac14afc-f45a-41e8-b5f8-b5b51dca2919 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1321 microversion: 2.1 time: 0.184219 Feb 28 10:32:25.582737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 63/123] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:25 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:25.990725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-8affe3c5-976e-4fe5-8852-f3efedf97b68 req-eb1095fa-6c37-44cd-81ac-45a259037452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ead279e-e2e9-4312-a47a-fbec064ce99b", "name": "network-vif-plugged", "status": "completed", "tag": "76aed61f-8cd7-4455-a163-d78d7f320a35"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:26.004438 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-8affe3c5-976e-4fe5-8852-f3efedf97b68 req-eb1095fa-6c37-44cd-81ac-45a259037452 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.005064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-8affe3c5-976e-4fe5-8852-f3efedf97b68 req-eb1095fa-6c37-44cd-81ac-45a259037452 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.022323 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a5623457-4cfe-4e40-aeba-018f62c4d9e9 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:26.023316 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-8affe3c5-976e-4fe5-8852-f3efedf97b68 req-eb1095fa-6c37-44cd-81ac-45a259037452 service nova] Creating event network-vif-plugged:76aed61f-8cd7-4455-a163-d78d7f320a35 for instance 1ead279e-e2e9-4312-a47a-fbec064ce99b on hv-cinder-maste Feb 28 10:32:26.024014 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a5623457-4cfe-4e40-aeba-018f62c4d9e9 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:26.029258 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-8affe3c5-976e-4fe5-8852-f3efedf97b68 req-eb1095fa-6c37-44cd-81ac-45a259037452 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043253 Feb 28 10:32:26.030170 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 61/124] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:26.032853 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a5623457-4cfe-4e40-aeba-018f62c4d9e9 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.033618 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a5623457-4cfe-4e40-aeba-018f62c4d9e9 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.040228 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a5623457-4cfe-4e40-aeba-018f62c4d9e9 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.040757 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a5623457-4cfe-4e40-aeba-018f62c4d9e9 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.300882 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a5623457-4cfe-4e40-aeba-018f62c4d9e9 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:26.308564 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a5623457-4cfe-4e40-aeba-018f62c4d9e9 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.291157 Feb 28 10:32:26.309337 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 64/125] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:26 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:26.346430 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:26.347995 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:26.354344 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.354835 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.355749 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.356286 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.491021 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:26.500389 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:26.502035 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:26.503304 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d71775d6-7e46-470a-ac4e-bcd14cfd4e2c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.161182 Feb 28 10:32:26.504078 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 62/126] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:26 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:26.509555 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-48faa6ed-c0b8-407f-909c-055750505feb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b02b6768-6abb-4e12-b2f7-c6401e0972c9"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:26.510720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-48faa6ed-c0b8-407f-909c-055750505feb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:26.517672 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48faa6ed-c0b8-407f-909c-055750505feb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.518171 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48faa6ed-c0b8-407f-909c-055750505feb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.518930 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48faa6ed-c0b8-407f-909c-055750505feb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.519541 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48faa6ed-c0b8-407f-909c-055750505feb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.598503 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-136a0039-516e-4373-a692-5616b943140d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:26.599253 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-136a0039-516e-4373-a692-5616b943140d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:26.605754 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-136a0039-516e-4373-a692-5616b943140d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.606395 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-136a0039-516e-4373-a692-5616b943140d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.607213 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-136a0039-516e-4373-a692-5616b943140d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.607699 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-136a0039-516e-4373-a692-5616b943140d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.763605 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-136a0039-516e-4373-a692-5616b943140d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:26.771706 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-136a0039-516e-4373-a692-5616b943140d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1515 microversion: 2.1 time: 0.177613 Feb 28 10:32:26.772266 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 63/127] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:26 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:26.790265 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7e6e5208-3cce-44aa-a60d-36f32df71617 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:26.791260 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7e6e5208-3cce-44aa-a60d-36f32df71617 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:26.798196 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7e6e5208-3cce-44aa-a60d-36f32df71617 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.798665 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7e6e5208-3cce-44aa-a60d-36f32df71617 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.799525 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7e6e5208-3cce-44aa-a60d-36f32df71617 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:26.799963 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7e6e5208-3cce-44aa-a60d-36f32df71617 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:26.872764 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-7e6e5208-3cce-44aa-a60d-36f32df71617 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lazy-loading 'flavor' on Instance uuid ae7de27a-2095-46ac-ade5-992422ccbb4e {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:32:27.010946 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7e6e5208-3cce-44aa-a60d-36f32df71617 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "POST /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e/action" status: 200 len: 32 microversion: 2.1 time: 0.224665 Feb 28 10:32:27.012834 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 64/128] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:32:26 2022] POST /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 28 10:32:27.012965 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-48faa6ed-c0b8-407f-909c-055750505feb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "POST /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507159 Feb 28 10:32:27.013560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 65/129] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:32:26 2022] POST /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:32:27.024021 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b0c81e1d-4159-43e1-8aa2-40814b42a0db tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:27.024871 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b0c81e1d-4159-43e1-8aa2-40814b42a0db tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:27.032202 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b0c81e1d-4159-43e1-8aa2-40814b42a0db tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:27.032811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b0c81e1d-4159-43e1-8aa2-40814b42a0db tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:27.033888 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b0c81e1d-4159-43e1-8aa2-40814b42a0db tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:27.034423 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b0c81e1d-4159-43e1-8aa2-40814b42a0db tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:27.263705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b0c81e1d-4159-43e1-8aa2-40814b42a0db tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:27.271374 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b0c81e1d-4159-43e1-8aa2-40814b42a0db tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.251872 Feb 28 10:32:27.271960 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 65/130] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:27 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:27.327818 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-43b20869-7e85-4b8a-8f08-5bc598b4beaf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:27.328713 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-43b20869-7e85-4b8a-8f08-5bc598b4beaf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:27.336292 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-43b20869-7e85-4b8a-8f08-5bc598b4beaf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:27.336962 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-43b20869-7e85-4b8a-8f08-5bc598b4beaf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:27.337934 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-43b20869-7e85-4b8a-8f08-5bc598b4beaf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:27.338383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-43b20869-7e85-4b8a-8f08-5bc598b4beaf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:27.396370 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-466104795", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "networks": [{"uuid": "53295920-84a0-4ffa-9aa6-cb61ab488d09"}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:27.455888 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] validate_networks() for [('53295920-84a0-4ffa-9aa6-cb61ab488d09', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:32:27.660122 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-43b20869-7e85-4b8a-8f08-5bc598b4beaf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:27.668362 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-43b20869-7e85-4b8a-8f08-5bc598b4beaf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.346312 Feb 28 10:32:27.669353 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 66/131] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:27 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:27.675153 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:27.675867 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:27.681664 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:27.682196 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:27.683205 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:27.683939 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:28.095328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:28.115027 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:28.117073 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:28.118566 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e5f18a05-0194-423e-85ca-92d2eed3a052 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1407 microversion: 2.20 time: 0.448068 Feb 28 10:32:28.119220 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 67/132] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:27 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:28.124967 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-14e8062d-77e5-4f3f-8ca0-ede5474a9c72 req-e731266f-b19a-43bc-88a5-94e93e6bdd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb676a4-94b3-4550-8eb3-b12a16f6f3ec", "name": "network-vif-plugged", "status": "completed", "tag": "b1a42156-5d5f-4727-a2fd-ca0b2cece4af"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:28.133898 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-14e8062d-77e5-4f3f-8ca0-ede5474a9c72 req-e731266f-b19a-43bc-88a5-94e93e6bdd8f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:28.134344 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-14e8062d-77e5-4f3f-8ca0-ede5474a9c72 req-e731266f-b19a-43bc-88a5-94e93e6bdd8f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:28.149028 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-14e8062d-77e5-4f3f-8ca0-ede5474a9c72 req-e731266f-b19a-43bc-88a5-94e93e6bdd8f service nova] Creating event network-vif-plugged:b1a42156-5d5f-4727-a2fd-ca0b2cece4af for instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec on hv-cinder-maste Feb 28 10:32:28.154718 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-14e8062d-77e5-4f3f-8ca0-ede5474a9c72 req-e731266f-b19a-43bc-88a5-94e93e6bdd8f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034127 Feb 28 10:32:28.155771 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 68/133] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:28.215593 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:32:28.216013 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:32:28.216486 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:32:28.216968 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:32:28.217316 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:32:28.227244 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:28.227787 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:28.228987 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:28.229427 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:28.247562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Getting quotas for project 6098811200df4998b4c983c44640d16f. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:32:28.251565 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Getting quotas for user 2c32548c092048afaf0a89eaccdc05cd and project 6098811200df4998b4c983c44640d16f. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:32:28.268615 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:32:28.271859 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:32:28.289577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5ebaa5dd-a9e5-46fb-be48-c002a5b05052 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:28.290286 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5ebaa5dd-a9e5-46fb-be48-c002a5b05052 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:28.299856 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5ebaa5dd-a9e5-46fb-be48-c002a5b05052 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:28.300473 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5ebaa5dd-a9e5-46fb-be48-c002a5b05052 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:28.301322 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5ebaa5dd-a9e5-46fb-be48-c002a5b05052 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:28.301769 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5ebaa5dd-a9e5-46fb-be48-c002a5b05052 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:28.339064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-1fc9b616-612f-420d-82f7-06a5d11de6d1 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947892 Feb 28 10:32:28.339759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 66/134] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 28 10:32:28.352443 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0ba9ccd4-0bf2-4426-8ee7-2639a6b7ed89 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:28.353660 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0ba9ccd4-0bf2-4426-8ee7-2639a6b7ed89 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:28.439655 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0ba9ccd4-0bf2-4426-8ee7-2639a6b7ed89 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:28.450510 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0ba9ccd4-0bf2-4426-8ee7-2639a6b7ed89 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1213 microversion: 2.1 time: 0.102841 Feb 28 10:32:28.454953 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 67/135] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:28 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:28.687970 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7dd13810-9dce-4652-b532-04c58fc13833 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:28.688742 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7dd13810-9dce-4652-b532-04c58fc13833 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:28.698233 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7dd13810-9dce-4652-b532-04c58fc13833 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:28.698233 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7dd13810-9dce-4652-b532-04c58fc13833 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:28.699103 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7dd13810-9dce-4652-b532-04c58fc13833 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:28.699699 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7dd13810-9dce-4652-b532-04c58fc13833 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:28.712887 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5ebaa5dd-a9e5-46fb-be48-c002a5b05052 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:28.721063 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5ebaa5dd-a9e5-46fb-be48-c002a5b05052 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.435936 Feb 28 10:32:28.726264 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 69/136] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:28 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:28.890375 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7dd13810-9dce-4652-b532-04c58fc13833 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:28.898081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7dd13810-9dce-4652-b532-04c58fc13833 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.216059 Feb 28 10:32:28.898786 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 68/137] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:28 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:29.138372 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:29.139030 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:29.145135 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.145583 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:29.146362 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.146835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:29.290802 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:29.298830 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:29.301469 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:29.302638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7d8d56b1-8a51-4f8f-afd6-c4ff041f4b58 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1599 microversion: 2.20 time: 0.169049 Feb 28 10:32:29.303187 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 70/138] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:32:29 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:32:29.320815 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-38a18c62-e417-4af3-aa8c-a6bf2f9a99cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:29.321299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-38a18c62-e417-4af3-aa8c-a6bf2f9a99cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:29.329289 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38a18c62-e417-4af3-aa8c-a6bf2f9a99cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.329823 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38a18c62-e417-4af3-aa8c-a6bf2f9a99cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:29.330706 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38a18c62-e417-4af3-aa8c-a6bf2f9a99cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.331157 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38a18c62-e417-4af3-aa8c-a6bf2f9a99cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:29.469487 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7e349a88-e9ea-498c-a347-b7047c49cbcc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:29.470115 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7e349a88-e9ea-498c-a347-b7047c49cbcc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:29.476644 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7e349a88-e9ea-498c-a347-b7047c49cbcc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.477283 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7e349a88-e9ea-498c-a347-b7047c49cbcc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:29.478093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7e349a88-e9ea-498c-a347-b7047c49cbcc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.478534 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7e349a88-e9ea-498c-a347-b7047c49cbcc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:29.554368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7e349a88-e9ea-498c-a347-b7047c49cbcc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:29.562764 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7e349a88-e9ea-498c-a347-b7047c49cbcc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1265 microversion: 2.1 time: 0.097679 Feb 28 10:32:29.563052 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 71/139] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:29 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:29.577349 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-38a18c62-e417-4af3-aa8c-a6bf2f9a99cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.260775 Feb 28 10:32:29.578048 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 69/140] 10.222.0.21 () {60 vars in 1315 bytes} [Mon Feb 28 10:32:29 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-interface => generated 284 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:32:29.739071 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b5b32f64-e27e-4763-bc80-87c04b8f909a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:29.739833 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b5b32f64-e27e-4763-bc80-87c04b8f909a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:29.746796 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b5b32f64-e27e-4763-bc80-87c04b8f909a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.746796 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b5b32f64-e27e-4763-bc80-87c04b8f909a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:29.747302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b5b32f64-e27e-4763-bc80-87c04b8f909a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.747742 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b5b32f64-e27e-4763-bc80-87c04b8f909a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:29.919595 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-71a53363-d1f8-4bed-8215-c4748902b32c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:29.920169 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-71a53363-d1f8-4bed-8215-c4748902b32c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:29.932095 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71a53363-d1f8-4bed-8215-c4748902b32c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.939370 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71a53363-d1f8-4bed-8215-c4748902b32c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:29.943879 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71a53363-d1f8-4bed-8215-c4748902b32c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:29.944743 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71a53363-d1f8-4bed-8215-c4748902b32c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:30.009098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b5b32f64-e27e-4763-bc80-87c04b8f909a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:30.019633 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b5b32f64-e27e-4763-bc80-87c04b8f909a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.283701 Feb 28 10:32:30.021065 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 72/141] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:29 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:30.264521 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-71a53363-d1f8-4bed-8215-c4748902b32c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:30.273136 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-71a53363-d1f8-4bed-8215-c4748902b32c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1363 microversion: 2.1 time: 0.357421 Feb 28 10:32:30.285932 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 70/142] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:29 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:30.580222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-36fd61ca-c16f-4b77-a3eb-b8a6c3962865 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:30.580645 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-36fd61ca-c16f-4b77-a3eb-b8a6c3962865 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:30.591302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-36fd61ca-c16f-4b77-a3eb-b8a6c3962865 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:30.593834 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-36fd61ca-c16f-4b77-a3eb-b8a6c3962865 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:30.594761 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-36fd61ca-c16f-4b77-a3eb-b8a6c3962865 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:30.595182 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-36fd61ca-c16f-4b77-a3eb-b8a6c3962865 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:30.931742 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-36fd61ca-c16f-4b77-a3eb-b8a6c3962865 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:30.958590 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-36fd61ca-c16f-4b77-a3eb-b8a6c3962865 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1271 microversion: 2.1 time: 0.380733 Feb 28 10:32:30.960850 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 73/143] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:30 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1271 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:31.039604 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0fc3b8e1-be47-45e7-a705-4e2c3550c9c7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:31.040432 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0fc3b8e1-be47-45e7-a705-4e2c3550c9c7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:31.051121 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0fc3b8e1-be47-45e7-a705-4e2c3550c9c7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:31.052011 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0fc3b8e1-be47-45e7-a705-4e2c3550c9c7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:31.053605 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0fc3b8e1-be47-45e7-a705-4e2c3550c9c7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:31.054726 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0fc3b8e1-be47-45e7-a705-4e2c3550c9c7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:31.271177 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0fc3b8e1-be47-45e7-a705-4e2c3550c9c7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:31.284174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0fc3b8e1-be47-45e7-a705-4e2c3550c9c7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.248134 Feb 28 10:32:31.305852 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f847bc90-2474-44a9-9943-246c34d81f07 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:31.307316 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f847bc90-2474-44a9-9943-246c34d81f07 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:31.311626 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 71/144] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:31 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:31.316892 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f847bc90-2474-44a9-9943-246c34d81f07 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:31.317621 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f847bc90-2474-44a9-9943-246c34d81f07 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:31.319720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f847bc90-2474-44a9-9943-246c34d81f07 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:31.322333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f847bc90-2474-44a9-9943-246c34d81f07 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:31.436644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f5848a1b-dd77-4b81-b2eb-a86a23da327d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:31.437149 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f5848a1b-dd77-4b81-b2eb-a86a23da327d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:31.444766 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f5848a1b-dd77-4b81-b2eb-a86a23da327d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:31.448573 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f5848a1b-dd77-4b81-b2eb-a86a23da327d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:31.451226 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f5848a1b-dd77-4b81-b2eb-a86a23da327d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:31.453708 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f5848a1b-dd77-4b81-b2eb-a86a23da327d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:31.490584 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f5848a1b-dd77-4b81-b2eb-a86a23da327d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/ips" status: 200 len: 112 microversion: 2.20 time: 0.059304 Feb 28 10:32:31.491415 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 72/145] 10.222.0.21 () {60 vars in 1288 bytes} [Mon Feb 28 10:32:31 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/ips => generated 112 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 10:32:31.501139 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-4cfa03ea-86d4-49c5-b3ce-77cc6798cc37 req-ad137a22-79c1-4bdd-9ecf-a926afda2655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ead279e-e2e9-4312-a47a-fbec064ce99b", "tag": "76aed61f-8cd7-4455-a163-d78d7f320a35"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:31.510777 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-4cfa03ea-86d4-49c5-b3ce-77cc6798cc37 req-ad137a22-79c1-4bdd-9ecf-a926afda2655 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:31.511501 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-4cfa03ea-86d4-49c5-b3ce-77cc6798cc37 req-ad137a22-79c1-4bdd-9ecf-a926afda2655 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:31.526370 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-4cfa03ea-86d4-49c5-b3ce-77cc6798cc37 req-ad137a22-79c1-4bdd-9ecf-a926afda2655 service nova] Creating event network-changed:76aed61f-8cd7-4455-a163-d78d7f320a35 for instance 1ead279e-e2e9-4312-a47a-fbec064ce99b on hv-cinder-maste Feb 28 10:32:31.533949 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-4cfa03ea-86d4-49c5-b3ce-77cc6798cc37 req-ad137a22-79c1-4bdd-9ecf-a926afda2655 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040686 Feb 28 10:32:31.538434 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 73/146] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:31.700910 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f847bc90-2474-44a9-9943-246c34d81f07 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:31.712541 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f847bc90-2474-44a9-9943-246c34d81f07 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1549 microversion: 2.1 time: 0.411880 Feb 28 10:32:31.717985 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 74/147] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:31 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1549 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:31.747942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7a98b990-f60d-4ed5-b682-68c36c19708d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:31.747942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7a98b990-f60d-4ed5-b682-68c36c19708d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:31.757164 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7a98b990-f60d-4ed5-b682-68c36c19708d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:31.757641 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7a98b990-f60d-4ed5-b682-68c36c19708d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:31.762017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7a98b990-f60d-4ed5-b682-68c36c19708d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:31.762497 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7a98b990-f60d-4ed5-b682-68c36c19708d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:31.983722 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-54c4a647-2256-4723-84b1-7e1020b07316 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:31.984983 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-54c4a647-2256-4723-84b1-7e1020b07316 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:31.998670 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-54c4a647-2256-4723-84b1-7e1020b07316 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:32.000445 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-54c4a647-2256-4723-84b1-7e1020b07316 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:32.004611 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-54c4a647-2256-4723-84b1-7e1020b07316 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:32.004820 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-54c4a647-2256-4723-84b1-7e1020b07316 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:32.131986 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7a98b990-f60d-4ed5-b682-68c36c19708d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.399205 Feb 28 10:32:32.133007 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 74/148] 10.222.0.21 () {58 vars in 1274 bytes} [Mon Feb 28 10:32:31 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/os-interface => generated 284 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:32.303857 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a2396c8a-0216-4cb0-97aa-264eac039b70 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:32.304729 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a2396c8a-0216-4cb0-97aa-264eac039b70 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:32.313174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a2396c8a-0216-4cb0-97aa-264eac039b70 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:32.314088 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a2396c8a-0216-4cb0-97aa-264eac039b70 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:32.315291 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a2396c8a-0216-4cb0-97aa-264eac039b70 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:32.316009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a2396c8a-0216-4cb0-97aa-264eac039b70 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:32.400373 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-54c4a647-2256-4723-84b1-7e1020b07316 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:32.411320 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-54c4a647-2256-4723-84b1-7e1020b07316 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.436561 Feb 28 10:32:32.414664 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 75/149] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:31 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:32.692608 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a2396c8a-0216-4cb0-97aa-264eac039b70 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:32.703868 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a2396c8a-0216-4cb0-97aa-264eac039b70 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.401496 Feb 28 10:32:32.704787 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 75/150] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:32 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:32.805040 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-5d047875-9eaa-401c-bd55-9ef94b6d8832 req-032a29df-24a4-4eaa-8785-60879e8d564f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df83f9d-01d6-4425-bd1e-202578b5e093", "tag": "f26e2946-1a0c-4bc6-b5f7-fd4f3bc7a664"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:32.818112 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-5d047875-9eaa-401c-bd55-9ef94b6d8832 req-032a29df-24a4-4eaa-8785-60879e8d564f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:32.822274 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-5d047875-9eaa-401c-bd55-9ef94b6d8832 req-032a29df-24a4-4eaa-8785-60879e8d564f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:32.844892 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-5d047875-9eaa-401c-bd55-9ef94b6d8832 req-032a29df-24a4-4eaa-8785-60879e8d564f service nova] Creating event network-changed:f26e2946-1a0c-4bc6-b5f7-fd4f3bc7a664 for instance 6df83f9d-01d6-4425-bd1e-202578b5e093 on hv-cinder-maste Feb 28 10:32:32.856954 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-5d047875-9eaa-401c-bd55-9ef94b6d8832 req-032a29df-24a4-4eaa-8785-60879e8d564f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056783 Feb 28 10:32:32.857563 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 76/151] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:33.429866 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-dddd62e6-ccb1-41db-bca5-b5ec590f06cd tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:33.430673 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-dddd62e6-ccb1-41db-bca5-b5ec590f06cd tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:33.437575 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dddd62e6-ccb1-41db-bca5-b5ec590f06cd tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:33.438124 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dddd62e6-ccb1-41db-bca5-b5ec590f06cd tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:33.439126 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dddd62e6-ccb1-41db-bca5-b5ec590f06cd tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:33.439559 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dddd62e6-ccb1-41db-bca5-b5ec590f06cd tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:33.600791 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9ced47cb-6905-47dc-94aa-cfab29e2e297 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:33.601393 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9ced47cb-6905-47dc-94aa-cfab29e2e297 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:33.609751 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9ced47cb-6905-47dc-94aa-cfab29e2e297 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:33.610197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9ced47cb-6905-47dc-94aa-cfab29e2e297 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:33.612849 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9ced47cb-6905-47dc-94aa-cfab29e2e297 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:33.613446 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9ced47cb-6905-47dc-94aa-cfab29e2e297 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:33.627721 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-dddd62e6-ccb1-41db-bca5-b5ec590f06cd tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:33.637089 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-dddd62e6-ccb1-41db-bca5-b5ec590f06cd tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.210279 Feb 28 10:32:33.638386 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 76/152] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:33 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:33.643386 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-57466920-ca56-4e81-8b20-c55e9ef6227c req-be8696fb-f029-48fc-81e5-c64b9beb53e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb676a4-94b3-4550-8eb3-b12a16f6f3ec", "tag": "b1a42156-5d5f-4727-a2fd-ca0b2cece4af"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:33.647042 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9ced47cb-6905-47dc-94aa-cfab29e2e297 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/ips" status: 200 len: 106 microversion: 2.1 time: 0.050595 Feb 28 10:32:33.647818 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 77/153] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 10:32:33 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/ips => generated 106 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:33.651551 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-57466920-ca56-4e81-8b20-c55e9ef6227c req-be8696fb-f029-48fc-81e5-c64b9beb53e6 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:33.652652 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-57466920-ca56-4e81-8b20-c55e9ef6227c req-be8696fb-f029-48fc-81e5-c64b9beb53e6 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:33.664789 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-57466920-ca56-4e81-8b20-c55e9ef6227c req-be8696fb-f029-48fc-81e5-c64b9beb53e6 service nova] Creating event network-changed:b1a42156-5d5f-4727-a2fd-ca0b2cece4af for instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec on hv-cinder-maste Feb 28 10:32:33.670176 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-57466920-ca56-4e81-8b20-c55e9ef6227c req-be8696fb-f029-48fc-81e5-c64b9beb53e6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030372 Feb 28 10:32:33.671956 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 77/154] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:33.722273 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d0260d2b-831b-4715-87c9-030ad74f9b05 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:33.723061 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d0260d2b-831b-4715-87c9-030ad74f9b05 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:33.729167 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0260d2b-831b-4715-87c9-030ad74f9b05 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:33.729636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0260d2b-831b-4715-87c9-030ad74f9b05 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:33.730520 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0260d2b-831b-4715-87c9-030ad74f9b05 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:33.730975 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0260d2b-831b-4715-87c9-030ad74f9b05 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:33.882706 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d0260d2b-831b-4715-87c9-030ad74f9b05 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:33.891109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d0260d2b-831b-4715-87c9-030ad74f9b05 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.172671 Feb 28 10:32:33.891937 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 78/155] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:33 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:34.655802 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-56bab378-db28-4eda-82b3-763f8f2b1c5e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:34.656514 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-56bab378-db28-4eda-82b3-763f8f2b1c5e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:34.666960 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-56bab378-db28-4eda-82b3-763f8f2b1c5e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:34.667436 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-56bab378-db28-4eda-82b3-763f8f2b1c5e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:34.669015 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-56bab378-db28-4eda-82b3-763f8f2b1c5e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:34.669526 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-56bab378-db28-4eda-82b3-763f8f2b1c5e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:34.908230 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-64cf3bfa-3100-4dda-be4d-15c64a8fbf3a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:34.910363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-64cf3bfa-3100-4dda-be4d-15c64a8fbf3a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:34.931645 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-64cf3bfa-3100-4dda-be4d-15c64a8fbf3a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:34.932121 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-64cf3bfa-3100-4dda-be4d-15c64a8fbf3a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:34.932940 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-64cf3bfa-3100-4dda-be4d-15c64a8fbf3a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:34.933426 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-64cf3bfa-3100-4dda-be4d-15c64a8fbf3a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:35.035722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-56bab378-db28-4eda-82b3-763f8f2b1c5e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:35.044159 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-56bab378-db28-4eda-82b3-763f8f2b1c5e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.393212 Feb 28 10:32:35.047905 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 78/156] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:34 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:35.370474 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-64cf3bfa-3100-4dda-be4d-15c64a8fbf3a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:35.379431 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-64cf3bfa-3100-4dda-be4d-15c64a8fbf3a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.475338 Feb 28 10:32:35.380236 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 79/157] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:34 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:36.064619 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6a8cfee0-44f9-4880-82f0-6c252a4052c4 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:36.065266 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6a8cfee0-44f9-4880-82f0-6c252a4052c4 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:36.071302 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a8cfee0-44f9-4880-82f0-6c252a4052c4 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:36.071731 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a8cfee0-44f9-4880-82f0-6c252a4052c4 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:36.072521 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a8cfee0-44f9-4880-82f0-6c252a4052c4 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:36.072986 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a8cfee0-44f9-4880-82f0-6c252a4052c4 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:36.318224 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6a8cfee0-44f9-4880-82f0-6c252a4052c4 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:36.328070 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6a8cfee0-44f9-4880-82f0-6c252a4052c4 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.267232 Feb 28 10:32:36.328988 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 79/158] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:36 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:36.397308 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e45d27d8-7e0d-4fda-9832-46df2fa71c5e tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:36.397917 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e45d27d8-7e0d-4fda-9832-46df2fa71c5e tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:36.404242 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e45d27d8-7e0d-4fda-9832-46df2fa71c5e tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:36.404715 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e45d27d8-7e0d-4fda-9832-46df2fa71c5e tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:36.405492 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e45d27d8-7e0d-4fda-9832-46df2fa71c5e tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:36.405929 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e45d27d8-7e0d-4fda-9832-46df2fa71c5e tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:36.629580 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e45d27d8-7e0d-4fda-9832-46df2fa71c5e tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:36.638024 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e45d27d8-7e0d-4fda-9832-46df2fa71c5e tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.244272 Feb 28 10:32:36.638611 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 80/159] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:36 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:37.344923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-76ae7030-51e7-47fd-bfa2-495723ed7271 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:37.345531 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-76ae7030-51e7-47fd-bfa2-495723ed7271 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:37.351355 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-76ae7030-51e7-47fd-bfa2-495723ed7271 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:37.351800 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-76ae7030-51e7-47fd-bfa2-495723ed7271 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:37.352565 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-76ae7030-51e7-47fd-bfa2-495723ed7271 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:37.352995 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-76ae7030-51e7-47fd-bfa2-495723ed7271 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:37.487945 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-76ae7030-51e7-47fd-bfa2-495723ed7271 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:37.495727 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-76ae7030-51e7-47fd-bfa2-495723ed7271 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.154678 Feb 28 10:32:37.496299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 80/160] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:37 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:37.656357 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-156a4cac-a2b5-4fd0-8cd4-f7b80649873b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:37.656970 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-156a4cac-a2b5-4fd0-8cd4-f7b80649873b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:37.663636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-156a4cac-a2b5-4fd0-8cd4-f7b80649873b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:37.664085 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-156a4cac-a2b5-4fd0-8cd4-f7b80649873b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:37.664876 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-156a4cac-a2b5-4fd0-8cd4-f7b80649873b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:37.665305 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-156a4cac-a2b5-4fd0-8cd4-f7b80649873b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:37.835617 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-156a4cac-a2b5-4fd0-8cd4-f7b80649873b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:37.844710 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-156a4cac-a2b5-4fd0-8cd4-f7b80649873b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.193709 Feb 28 10:32:37.845272 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 81/161] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:37 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:38.514174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a21235d0-8208-46cb-afeb-2ae66cbf0820 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:38.514817 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a21235d0-8208-46cb-afeb-2ae66cbf0820 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:38.520571 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a21235d0-8208-46cb-afeb-2ae66cbf0820 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:38.521024 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a21235d0-8208-46cb-afeb-2ae66cbf0820 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:38.521801 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a21235d0-8208-46cb-afeb-2ae66cbf0820 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:38.522232 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a21235d0-8208-46cb-afeb-2ae66cbf0820 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:38.655697 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a21235d0-8208-46cb-afeb-2ae66cbf0820 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:38.662984 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a21235d0-8208-46cb-afeb-2ae66cbf0820 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.153301 Feb 28 10:32:38.663541 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 81/162] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:38 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:38.862944 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-efdddbe7-a778-43ae-b039-acaa577c7379 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:38.863553 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-efdddbe7-a778-43ae-b039-acaa577c7379 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:38.869756 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-efdddbe7-a778-43ae-b039-acaa577c7379 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:38.870202 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-efdddbe7-a778-43ae-b039-acaa577c7379 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:38.870998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-efdddbe7-a778-43ae-b039-acaa577c7379 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:38.871434 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-efdddbe7-a778-43ae-b039-acaa577c7379 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:39.005971 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-efdddbe7-a778-43ae-b039-acaa577c7379 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:39.013604 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-efdddbe7-a778-43ae-b039-acaa577c7379 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.154494 Feb 28 10:32:39.014190 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 82/163] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:38 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:39.679581 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3f08fd71-83d7-4e2e-ac6a-bfb01e9cb8a9 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:39.680262 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3f08fd71-83d7-4e2e-ac6a-bfb01e9cb8a9 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:39.686365 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f08fd71-83d7-4e2e-ac6a-bfb01e9cb8a9 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:39.686848 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f08fd71-83d7-4e2e-ac6a-bfb01e9cb8a9 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:39.687642 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f08fd71-83d7-4e2e-ac6a-bfb01e9cb8a9 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:39.688081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f08fd71-83d7-4e2e-ac6a-bfb01e9cb8a9 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:39.955217 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3f08fd71-83d7-4e2e-ac6a-bfb01e9cb8a9 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:39.962821 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3f08fd71-83d7-4e2e-ac6a-bfb01e9cb8a9 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.287026 Feb 28 10:32:39.963396 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 82/164] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:39 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:40.030694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2e60ad30-a5af-460c-9e34-584485bfd917 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:40.031309 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2e60ad30-a5af-460c-9e34-584485bfd917 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:40.037507 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e60ad30-a5af-460c-9e34-584485bfd917 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:40.037958 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e60ad30-a5af-460c-9e34-584485bfd917 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:40.038769 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e60ad30-a5af-460c-9e34-584485bfd917 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:40.039285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e60ad30-a5af-460c-9e34-584485bfd917 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:40.173293 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2e60ad30-a5af-460c-9e34-584485bfd917 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:40.180505 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2e60ad30-a5af-460c-9e34-584485bfd917 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.154289 Feb 28 10:32:40.181151 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 83/165] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:40 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:40.979032 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b4435390-83bf-425c-8fbb-d4f92db44dce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:40.979643 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b4435390-83bf-425c-8fbb-d4f92db44dce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:40.986512 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b4435390-83bf-425c-8fbb-d4f92db44dce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:40.986984 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b4435390-83bf-425c-8fbb-d4f92db44dce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:40.987773 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b4435390-83bf-425c-8fbb-d4f92db44dce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:40.988206 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b4435390-83bf-425c-8fbb-d4f92db44dce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:41.025906 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c1f162c3-0a60-4d99-b44e-f4601dc1f7d6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:41.026383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c1f162c3-0a60-4d99-b44e-f4601dc1f7d6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:41.035779 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1f162c3-0a60-4d99-b44e-f4601dc1f7d6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:41.037496 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1f162c3-0a60-4d99-b44e-f4601dc1f7d6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:41.038519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1f162c3-0a60-4d99-b44e-f4601dc1f7d6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:41.039231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1f162c3-0a60-4d99-b44e-f4601dc1f7d6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:41.086824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c1f162c3-0a60-4d99-b44e-f4601dc1f7d6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:32:41.149818 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b4435390-83bf-425c-8fbb-d4f92db44dce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:41.158343 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b4435390-83bf-425c-8fbb-d4f92db44dce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.183003 Feb 28 10:32:41.158946 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 83/166] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:40 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:41.187434 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c1f162c3-0a60-4d99-b44e-f4601dc1f7d6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "DELETE /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 204 len: 0 microversion: 2.1 time: 0.165261 Feb 28 10:32:41.191245 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 84/167] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:32:41 2022] DELETE /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:32:41.197895 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ac305930-f87d-4ab2-8ff6-d2b200b378f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:41.198731 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ac305930-f87d-4ab2-8ff6-d2b200b378f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:41.203637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-873dea2d-552f-4bf1-87e1-588472ebe49d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:41.206229 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-873dea2d-552f-4bf1-87e1-588472ebe49d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:41.206947 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac305930-f87d-4ab2-8ff6-d2b200b378f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:41.207432 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac305930-f87d-4ab2-8ff6-d2b200b378f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:41.208304 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac305930-f87d-4ab2-8ff6-d2b200b378f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:41.208821 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac305930-f87d-4ab2-8ff6-d2b200b378f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:41.216940 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-873dea2d-552f-4bf1-87e1-588472ebe49d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:41.217683 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-873dea2d-552f-4bf1-87e1-588472ebe49d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:41.218480 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-873dea2d-552f-4bf1-87e1-588472ebe49d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:41.218952 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-873dea2d-552f-4bf1-87e1-588472ebe49d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:41.427185 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-873dea2d-552f-4bf1-87e1-588472ebe49d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:41.430264 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ac305930-f87d-4ab2-8ff6-d2b200b378f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:41.436053 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-873dea2d-552f-4bf1-87e1-588472ebe49d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1553 microversion: 2.1 time: 0.243510 Feb 28 10:32:41.436804 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 84/168] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:41 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1553 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:41.439646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ac305930-f87d-4ab2-8ff6-d2b200b378f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.245872 Feb 28 10:32:41.448037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 85/169] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:41 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:42.175098 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9a046a77-b689-4ac4-bc90-a9d7ca5fad5d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:42.175709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9a046a77-b689-4ac4-bc90-a9d7ca5fad5d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:42.181611 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9a046a77-b689-4ac4-bc90-a9d7ca5fad5d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:42.182070 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9a046a77-b689-4ac4-bc90-a9d7ca5fad5d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:42.182881 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9a046a77-b689-4ac4-bc90-a9d7ca5fad5d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:42.183319 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9a046a77-b689-4ac4-bc90-a9d7ca5fad5d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:42.314913 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9a046a77-b689-4ac4-bc90-a9d7ca5fad5d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:42.322419 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9a046a77-b689-4ac4-bc90-a9d7ca5fad5d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.151183 Feb 28 10:32:42.323004 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 85/170] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:42 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:42.454012 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8b53aea8-5619-4072-8afa-4696dfebd8c4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:42.454633 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8b53aea8-5619-4072-8afa-4696dfebd8c4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:42.456692 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5ae1cb3f-ad6f-494e-b46b-deab8fb3c87a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:42.457309 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5ae1cb3f-ad6f-494e-b46b-deab8fb3c87a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:42.461322 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8b53aea8-5619-4072-8afa-4696dfebd8c4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:42.461768 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8b53aea8-5619-4072-8afa-4696dfebd8c4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:42.462543 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8b53aea8-5619-4072-8afa-4696dfebd8c4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:42.462994 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8b53aea8-5619-4072-8afa-4696dfebd8c4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:42.463331 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ae1cb3f-ad6f-494e-b46b-deab8fb3c87a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:42.463784 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ae1cb3f-ad6f-494e-b46b-deab8fb3c87a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:42.464566 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ae1cb3f-ad6f-494e-b46b-deab8fb3c87a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:42.465006 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ae1cb3f-ad6f-494e-b46b-deab8fb3c87a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:42.665304 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5ae1cb3f-ad6f-494e-b46b-deab8fb3c87a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:42.670144 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8b53aea8-5619-4072-8afa-4696dfebd8c4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:42.673282 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5ae1cb3f-ad6f-494e-b46b-deab8fb3c87a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.220355 Feb 28 10:32:42.673852 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 86/171] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:42 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:42.678122 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8b53aea8-5619-4072-8afa-4696dfebd8c4 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1553 microversion: 2.1 time: 0.228831 Feb 28 10:32:42.678781 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 86/172] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:42 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:43.340343 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f3b82844-275e-4f0c-a96b-f5a6ee572bc3 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:43.341577 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f3b82844-275e-4f0c-a96b-f5a6ee572bc3 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:43.347633 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f3b82844-275e-4f0c-a96b-f5a6ee572bc3 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:43.348087 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f3b82844-275e-4f0c-a96b-f5a6ee572bc3 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:43.348867 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f3b82844-275e-4f0c-a96b-f5a6ee572bc3 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:43.349303 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f3b82844-275e-4f0c-a96b-f5a6ee572bc3 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:43.485840 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f3b82844-275e-4f0c-a96b-f5a6ee572bc3 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:43.493116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f3b82844-275e-4f0c-a96b-f5a6ee572bc3 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.156622 Feb 28 10:32:43.493682 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 87/173] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:43 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:43.690446 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d655e165-2cba-4c32-a2f3-eb04c57dfa0d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:43.691301 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d655e165-2cba-4c32-a2f3-eb04c57dfa0d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:43.695839 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8805ebac-e8c1-4011-a8d2-829e188d88c6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:43.696547 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8805ebac-e8c1-4011-a8d2-829e188d88c6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:43.697788 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d655e165-2cba-4c32-a2f3-eb04c57dfa0d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:43.698251 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d655e165-2cba-4c32-a2f3-eb04c57dfa0d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:43.699053 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d655e165-2cba-4c32-a2f3-eb04c57dfa0d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:43.699492 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d655e165-2cba-4c32-a2f3-eb04c57dfa0d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:43.703331 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8805ebac-e8c1-4011-a8d2-829e188d88c6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:43.703989 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8805ebac-e8c1-4011-a8d2-829e188d88c6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:43.704774 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8805ebac-e8c1-4011-a8d2-829e188d88c6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:43.705362 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8805ebac-e8c1-4011-a8d2-829e188d88c6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:43.912751 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8805ebac-e8c1-4011-a8d2-829e188d88c6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:43.916121 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d655e165-2cba-4c32-a2f3-eb04c57dfa0d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:43.921735 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8805ebac-e8c1-4011-a8d2-829e188d88c6 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1553 microversion: 2.1 time: 0.229841 Feb 28 10:32:43.922535 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 88/174] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:43 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:43.931374 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d655e165-2cba-4c32-a2f3-eb04c57dfa0d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.238465 Feb 28 10:32:43.931374 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 87/175] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:43 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:44.509075 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-871177e8-b36a-41fa-8860-1ee569595e50 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:44.509685 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-871177e8-b36a-41fa-8860-1ee569595e50 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:44.516268 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-871177e8-b36a-41fa-8860-1ee569595e50 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:44.516740 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-871177e8-b36a-41fa-8860-1ee569595e50 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:44.517575 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-871177e8-b36a-41fa-8860-1ee569595e50 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:44.518011 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-871177e8-b36a-41fa-8860-1ee569595e50 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:44.649257 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-871177e8-b36a-41fa-8860-1ee569595e50 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:44.657050 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-871177e8-b36a-41fa-8860-1ee569595e50 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.151809 Feb 28 10:32:44.657615 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 88/176] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:44 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:44.939650 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-fbcf6e9d-6eb0-4c6b-a2ec-155a113bcc2f tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:44.940263 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-fbcf6e9d-6eb0-4c6b-a2ec-155a113bcc2f tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:44.942028 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b99eec3e-1a0c-4f1a-9f38-ef0e6bef73fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:44.942663 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b99eec3e-1a0c-4f1a-9f38-ef0e6bef73fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:44.946191 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fbcf6e9d-6eb0-4c6b-a2ec-155a113bcc2f tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:44.946669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fbcf6e9d-6eb0-4c6b-a2ec-155a113bcc2f tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:44.947454 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fbcf6e9d-6eb0-4c6b-a2ec-155a113bcc2f tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:44.947888 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fbcf6e9d-6eb0-4c6b-a2ec-155a113bcc2f tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:44.949058 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b99eec3e-1a0c-4f1a-9f38-ef0e6bef73fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:44.949450 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b99eec3e-1a0c-4f1a-9f38-ef0e6bef73fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:44.950232 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b99eec3e-1a0c-4f1a-9f38-ef0e6bef73fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:44.950826 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b99eec3e-1a0c-4f1a-9f38-ef0e6bef73fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:45.146194 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fbcf6e9d-6eb0-4c6b-a2ec-155a113bcc2f tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:45.157545 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-fbcf6e9d-6eb0-4c6b-a2ec-155a113bcc2f tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1553 microversion: 2.1 time: 0.222554 Feb 28 10:32:45.158155 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 89/177] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:44 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:45.160904 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b99eec3e-1a0c-4f1a-9f38-ef0e6bef73fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:45.168199 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b99eec3e-1a0c-4f1a-9f38-ef0e6bef73fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.229932 Feb 28 10:32:45.168780 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 89/178] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:44 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:45.673650 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ef15f4c2-1823-4caf-b5bb-df4a8a58751d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:45.674254 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ef15f4c2-1823-4caf-b5bb-df4a8a58751d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:45.680882 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ef15f4c2-1823-4caf-b5bb-df4a8a58751d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:45.681333 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ef15f4c2-1823-4caf-b5bb-df4a8a58751d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:45.682120 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ef15f4c2-1823-4caf-b5bb-df4a8a58751d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:45.682558 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ef15f4c2-1823-4caf-b5bb-df4a8a58751d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:45.819102 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ef15f4c2-1823-4caf-b5bb-df4a8a58751d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:45.827034 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ef15f4c2-1823-4caf-b5bb-df4a8a58751d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.157641 Feb 28 10:32:45.827597 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 90/179] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:45 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:46.174481 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-adb911fd-1403-4fa3-852c-c0f8019328f2 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:46.175236 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-adb911fd-1403-4fa3-852c-c0f8019328f2 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:46.182109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-adb911fd-1403-4fa3-852c-c0f8019328f2 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:46.182557 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-adb911fd-1403-4fa3-852c-c0f8019328f2 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:46.183362 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-adb911fd-1403-4fa3-852c-c0f8019328f2 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:46.183797 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-adb911fd-1403-4fa3-852c-c0f8019328f2 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:46.186725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-50a73741-5de4-459d-ab71-41ba7a73a7d4 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:46.187342 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-50a73741-5de4-459d-ab71-41ba7a73a7d4 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:46.193198 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-50a73741-5de4-459d-ab71-41ba7a73a7d4 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:46.193682 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-50a73741-5de4-459d-ab71-41ba7a73a7d4 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:46.194535 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-50a73741-5de4-459d-ab71-41ba7a73a7d4 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:46.194997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-50a73741-5de4-459d-ab71-41ba7a73a7d4 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:46.381545 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-adb911fd-1403-4fa3-852c-c0f8019328f2 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:46.385645 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-50a73741-5de4-459d-ab71-41ba7a73a7d4 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:46.389462 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-adb911fd-1403-4fa3-852c-c0f8019328f2 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1553 microversion: 2.1 time: 0.218783 Feb 28 10:32:46.390027 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 90/180] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:46 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:46.393235 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-50a73741-5de4-459d-ab71-41ba7a73a7d4 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.210948 Feb 28 10:32:46.393900 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 91/181] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:46 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:46.844333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2ccc933f-2ced-48b7-aaec-9a358a4b4174 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:46.844947 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2ccc933f-2ced-48b7-aaec-9a358a4b4174 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:46.850986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2ccc933f-2ced-48b7-aaec-9a358a4b4174 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:46.851447 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2ccc933f-2ced-48b7-aaec-9a358a4b4174 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:46.852214 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2ccc933f-2ced-48b7-aaec-9a358a4b4174 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:46.852644 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2ccc933f-2ced-48b7-aaec-9a358a4b4174 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:46.985915 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2ccc933f-2ced-48b7-aaec-9a358a4b4174 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:46.993036 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2ccc933f-2ced-48b7-aaec-9a358a4b4174 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.153095 Feb 28 10:32:46.993590 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 91/182] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:46 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:47.407543 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c8f1c8f1-1659-41b6-a59f-197e5faf649d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:47.408454 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c8f1c8f1-1659-41b6-a59f-197e5faf649d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:47.410419 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-92163a4e-6411-4cd8-9385-acced8b52e24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:47.411059 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-92163a4e-6411-4cd8-9385-acced8b52e24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:47.414793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c8f1c8f1-1659-41b6-a59f-197e5faf649d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:47.415243 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c8f1c8f1-1659-41b6-a59f-197e5faf649d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:47.416046 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c8f1c8f1-1659-41b6-a59f-197e5faf649d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:47.416474 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c8f1c8f1-1659-41b6-a59f-197e5faf649d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:47.416992 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-92163a4e-6411-4cd8-9385-acced8b52e24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:47.417449 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-92163a4e-6411-4cd8-9385-acced8b52e24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:47.418226 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-92163a4e-6411-4cd8-9385-acced8b52e24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:47.418864 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-92163a4e-6411-4cd8-9385-acced8b52e24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:47.621903 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-92163a4e-6411-4cd8-9385-acced8b52e24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:47.626082 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c8f1c8f1-1659-41b6-a59f-197e5faf649d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:47.630027 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-92163a4e-6411-4cd8-9385-acced8b52e24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.224020 Feb 28 10:32:47.630617 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 92/183] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:47 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:47.633719 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c8f1c8f1-1659-41b6-a59f-197e5faf649d tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1553 microversion: 2.1 time: 0.231176 Feb 28 10:32:47.634448 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 92/184] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:47 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:48.009880 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4f7c926a-4b4f-4021-a002-a9134989fb16 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:48.010486 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4f7c926a-4b4f-4021-a002-a9134989fb16 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:48.017030 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4f7c926a-4b4f-4021-a002-a9134989fb16 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:48.017487 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4f7c926a-4b4f-4021-a002-a9134989fb16 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:48.018256 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4f7c926a-4b4f-4021-a002-a9134989fb16 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:48.018712 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4f7c926a-4b4f-4021-a002-a9134989fb16 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:48.155388 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4f7c926a-4b4f-4021-a002-a9134989fb16 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:48.162620 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4f7c926a-4b4f-4021-a002-a9134989fb16 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.156775 Feb 28 10:32:48.163197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 93/185] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:48 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:48.649034 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a0a4f2e7-3144-4d89-8219-07864ec46227 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:48.649923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a0a4f2e7-3144-4d89-8219-07864ec46227 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:48.659693 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a0a4f2e7-3144-4d89-8219-07864ec46227 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:48.659693 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a0a4f2e7-3144-4d89-8219-07864ec46227 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:48.659926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-cd233649-56ef-4dbd-b216-c999fe59f0bb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:48.660352 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a0a4f2e7-3144-4d89-8219-07864ec46227 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:48.660352 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a0a4f2e7-3144-4d89-8219-07864ec46227 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:48.660512 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-cd233649-56ef-4dbd-b216-c999fe59f0bb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:48.668638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd233649-56ef-4dbd-b216-c999fe59f0bb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:48.669759 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd233649-56ef-4dbd-b216-c999fe59f0bb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:48.670766 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd233649-56ef-4dbd-b216-c999fe59f0bb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:48.671218 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd233649-56ef-4dbd-b216-c999fe59f0bb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:48.999351 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a0a4f2e7-3144-4d89-8219-07864ec46227 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:49.007873 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a0a4f2e7-3144-4d89-8219-07864ec46227 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.363905 Feb 28 10:32:49.008875 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 93/186] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:48 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:49.026231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-cd233649-56ef-4dbd-b216-c999fe59f0bb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:49.037749 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-cd233649-56ef-4dbd-b216-c999fe59f0bb tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1553 microversion: 2.1 time: 0.389438 Feb 28 10:32:49.038581 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 94/187] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:48 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:49.179345 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-27c1f6ee-abbb-491a-a9f0-e6bd927bd67d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:49.180123 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-27c1f6ee-abbb-491a-a9f0-e6bd927bd67d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:49.188495 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-27c1f6ee-abbb-491a-a9f0-e6bd927bd67d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:49.188929 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-27c1f6ee-abbb-491a-a9f0-e6bd927bd67d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:49.189746 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-27c1f6ee-abbb-491a-a9f0-e6bd927bd67d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:49.190224 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-27c1f6ee-abbb-491a-a9f0-e6bd927bd67d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:49.390034 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-06f429b0-495f-4449-96b2-1c632cc3a820 req-b8b175fd-8313-4af5-ac44-58616c5562dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42df3b45-4c1d-4d70-a36e-1ad74ba36a4e", "name": "network-vif-deleted", "tag": "9d3f112a-0650-404c-920f-c6a38ab77372"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:49.402120 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-06f429b0-495f-4449-96b2-1c632cc3a820 req-b8b175fd-8313-4af5-ac44-58616c5562dd service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:49.402754 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-06f429b0-495f-4449-96b2-1c632cc3a820 req-b8b175fd-8313-4af5-ac44-58616c5562dd service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:49.414831 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-06f429b0-495f-4449-96b2-1c632cc3a820 req-b8b175fd-8313-4af5-ac44-58616c5562dd service nova] Creating event network-vif-deleted:9d3f112a-0650-404c-920f-c6a38ab77372 for instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e on hv-cinder-maste Feb 28 10:32:49.421564 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-06f429b0-495f-4449-96b2-1c632cc3a820 req-b8b175fd-8313-4af5-ac44-58616c5562dd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039301 Feb 28 10:32:49.426713 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 95/188] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:49.501407 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-27c1f6ee-abbb-491a-a9f0-e6bd927bd67d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:49.508749 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-27c1f6ee-abbb-491a-a9f0-e6bd927bd67d tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.333524 Feb 28 10:32:49.509494 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 94/189] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:49 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:50.030753 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-51e660bf-7315-4d25-97ad-98f629522736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:50.031579 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-51e660bf-7315-4d25-97ad-98f629522736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:50.043880 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-51e660bf-7315-4d25-97ad-98f629522736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:50.048955 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-51e660bf-7315-4d25-97ad-98f629522736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:50.051419 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-51e660bf-7315-4d25-97ad-98f629522736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:50.051869 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-51e660bf-7315-4d25-97ad-98f629522736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:50.055927 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:50.063627 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:50.075283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:50.076306 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:50.077192 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:50.077633 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:50.134871 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:50.135333 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:50.137413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lazy-loading 'fault' on Instance uuid 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:32:50.251676 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ea80a65cbe4394bb9c7d3b73287655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ab7d83969f4e2ea219ab1eb98cf29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:50.252854 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-51e660bf-7315-4d25-97ad-98f629522736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:50.260569 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-51e660bf-7315-4d25-97ad-98f629522736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.238916 Feb 28 10:32:50.262072 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 96/190] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:50 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:50.264944 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-75f25842-e216-47af-be31-2fc2cba09712 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 200 len: 1350 microversion: 2.1 time: 0.213017 Feb 28 10:32:50.266501 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 95/191] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:50 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 1350 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:50.304625 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-02faf066-d9d2-4a55-bcc0-5ef2dfb190ca req-7ccd16fd-c7d5-4ad3-a562-170cc5e78596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df83f9d-01d6-4425-bd1e-202578b5e093", "name": "network-vif-plugged", "status": "completed", "tag": "f26e2946-1a0c-4bc6-b5f7-fd4f3bc7a664"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:50.314760 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-02faf066-d9d2-4a55-bcc0-5ef2dfb190ca req-7ccd16fd-c7d5-4ad3-a562-170cc5e78596 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:50.315209 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-02faf066-d9d2-4a55-bcc0-5ef2dfb190ca req-7ccd16fd-c7d5-4ad3-a562-170cc5e78596 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:50.331888 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-02faf066-d9d2-4a55-bcc0-5ef2dfb190ca req-7ccd16fd-c7d5-4ad3-a562-170cc5e78596 service nova] Creating event network-vif-plugged:f26e2946-1a0c-4bc6-b5f7-fd4f3bc7a664 for instance 6df83f9d-01d6-4425-bd1e-202578b5e093 on hv-cinder-maste Feb 28 10:32:50.354373 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-02faf066-d9d2-4a55-bcc0-5ef2dfb190ca req-7ccd16fd-c7d5-4ad3-a562-170cc5e78596 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053546 Feb 28 10:32:50.355363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 97/192] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:50.526367 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a213123b-f78c-46eb-a35d-00122eb28052 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:50.527512 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a213123b-f78c-46eb-a35d-00122eb28052 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:50.537064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a213123b-f78c-46eb-a35d-00122eb28052 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:50.537602 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a213123b-f78c-46eb-a35d-00122eb28052 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:50.538592 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a213123b-f78c-46eb-a35d-00122eb28052 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:50.539232 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a213123b-f78c-46eb-a35d-00122eb28052 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:50.724701 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a213123b-f78c-46eb-a35d-00122eb28052 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:50.739092 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a213123b-f78c-46eb-a35d-00122eb28052 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.217156 Feb 28 10:32:50.739538 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 96/193] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:50 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:51.279729 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1939780e-c2b4-4703-b81f-1fc04474cd93 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:51.280431 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1939780e-c2b4-4703-b81f-1fc04474cd93 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:51.284645 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-dade593d-ccfb-4e21-91cd-4749fdc38181 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:51.285798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-dade593d-ccfb-4e21-91cd-4749fdc38181 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:51.286493 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1939780e-c2b4-4703-b81f-1fc04474cd93 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:51.287004 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1939780e-c2b4-4703-b81f-1fc04474cd93 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:51.287948 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1939780e-c2b4-4703-b81f-1fc04474cd93 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:51.288834 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1939780e-c2b4-4703-b81f-1fc04474cd93 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:51.291630 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dade593d-ccfb-4e21-91cd-4749fdc38181 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:51.292083 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dade593d-ccfb-4e21-91cd-4749fdc38181 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:51.292860 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dade593d-ccfb-4e21-91cd-4749fdc38181 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:51.293294 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dade593d-ccfb-4e21-91cd-4749fdc38181 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:51.307591 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-dade593d-ccfb-4e21-91cd-4749fdc38181 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] HTTP exception thrown: Instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e could not be found. Feb 28 10:32:51.308179 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-dade593d-ccfb-4e21-91cd-4749fdc38181 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Returning 404 to user: Instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:32:51.308987 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-dade593d-ccfb-4e21-91cd-4749fdc38181 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 404 len: 111 microversion: 2.1 time: 0.030688 Feb 28 10:32:51.309560 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 97/194] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:51 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 10:32:51.440918 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-adb5d619-f007-4dd6-ad0e-0f0571f459e1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:51.442114 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-adb5d619-f007-4dd6-ad0e-0f0571f459e1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:51.448712 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-adb5d619-f007-4dd6-ad0e-0f0571f459e1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:51.449305 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-adb5d619-f007-4dd6-ad0e-0f0571f459e1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:51.453670 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-adb5d619-f007-4dd6-ad0e-0f0571f459e1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:51.456452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1939780e-c2b4-4703-b81f-1fc04474cd93 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:51.457633 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-adb5d619-f007-4dd6-ad0e-0f0571f459e1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:51.467604 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1939780e-c2b4-4703-b81f-1fc04474cd93 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.193188 Feb 28 10:32:51.468038 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 98/195] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:51 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:51.473285 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-adb5d619-f007-4dd6-ad0e-0f0571f459e1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] HTTP exception thrown: Instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e could not be found. Feb 28 10:32:51.474042 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-adb5d619-f007-4dd6-ad0e-0f0571f459e1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Returning 404 to user: Instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:32:51.475047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-adb5d619-f007-4dd6-ad0e-0f0571f459e1 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038547 Feb 28 10:32:51.475754 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 98/196] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:32:51 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 10:32:51.757918 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e94bb1c8-4a72-46fd-9a80-4e8f2704892f tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:51.758767 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e94bb1c8-4a72-46fd-9a80-4e8f2704892f tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:51.765012 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e94bb1c8-4a72-46fd-9a80-4e8f2704892f tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:51.765535 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e94bb1c8-4a72-46fd-9a80-4e8f2704892f tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:51.766418 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e94bb1c8-4a72-46fd-9a80-4e8f2704892f tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:51.766950 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e94bb1c8-4a72-46fd-9a80-4e8f2704892f tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:51.917033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e94bb1c8-4a72-46fd-9a80-4e8f2704892f tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:51.924897 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e94bb1c8-4a72-46fd-9a80-4e8f2704892f tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1313 microversion: 2.1 time: 0.171104 Feb 28 10:32:51.925468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 99/197] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:51 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:52.486191 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ae81745d-cb71-495e-8b4d-4a0c1d7295e9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:52.486956 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ae81745d-cb71-495e-8b4d-4a0c1d7295e9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:52.495748 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ae81745d-cb71-495e-8b4d-4a0c1d7295e9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:52.496306 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ae81745d-cb71-495e-8b4d-4a0c1d7295e9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:52.497063 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ae81745d-cb71-495e-8b4d-4a0c1d7295e9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:52.498058 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ae81745d-cb71-495e-8b4d-4a0c1d7295e9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:52.639562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ae81745d-cb71-495e-8b4d-4a0c1d7295e9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:52.646838 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ae81745d-cb71-495e-8b4d-4a0c1d7295e9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.165133 Feb 28 10:32:52.647396 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 99/198] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:52 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:52.693828 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-29a084d7-a152-4a6a-ba99-d6a7a7e04646 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:52.694354 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-29a084d7-a152-4a6a-ba99-d6a7a7e04646 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:52.700533 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29a084d7-a152-4a6a-ba99-d6a7a7e04646 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:52.700978 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29a084d7-a152-4a6a-ba99-d6a7a7e04646 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:52.701750 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29a084d7-a152-4a6a-ba99-d6a7a7e04646 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:52.702177 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29a084d7-a152-4a6a-ba99-d6a7a7e04646 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:52.716559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-29a084d7-a152-4a6a-ba99-d6a7a7e04646 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] HTTP exception thrown: Instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e could not be found. Feb 28 10:32:52.717145 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-29a084d7-a152-4a6a-ba99-d6a7a7e04646 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Returning 404 to user: Instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:32:52.717962 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-29a084d7-a152-4a6a-ba99-d6a7a7e04646 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "DELETE /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 404 len: 111 microversion: 2.1 time: 0.028467 Feb 28 10:32:52.718488 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 100/199] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:32:52 2022] DELETE /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:32:52.726421 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6aa785de-2d18-45ba-8500-f358ba250cf8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:52.727216 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6aa785de-2d18-45ba-8500-f358ba250cf8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] [instance: 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:52.733847 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6aa785de-2d18-45ba-8500-f358ba250cf8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:52.734296 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6aa785de-2d18-45ba-8500-f358ba250cf8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:52.735106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6aa785de-2d18-45ba-8500-f358ba250cf8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:52.735548 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6aa785de-2d18-45ba-8500-f358ba250cf8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:52.748980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-6aa785de-2d18-45ba-8500-f358ba250cf8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] HTTP exception thrown: Instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e could not be found. Feb 28 10:32:52.749569 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6aa785de-2d18-45ba-8500-f358ba250cf8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] Returning 404 to user: Instance 42df3b45-4c1d-4d70-a36e-1ad74ba36a4e could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:32:52.750388 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6aa785de-2d18-45ba-8500-f358ba250cf8 tempest-DeleteServersTestJSON-1624159057 tempest-DeleteServersTestJSON-1624159057-project] 10.222.0.21 "GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e" status: 404 len: 111 microversion: 2.1 time: 0.027814 Feb 28 10:32:52.750956 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 100/200] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:52 2022] GET /compute/v2.1/servers/42df3b45-4c1d-4d70-a36e-1ad74ba36a4e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:32:52.941455 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a6111938-9c7f-4857-ac75-f48f41e85f91 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:52.942067 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a6111938-9c7f-4857-ac75-f48f41e85f91 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:52.958149 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a6111938-9c7f-4857-ac75-f48f41e85f91 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:52.958631 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a6111938-9c7f-4857-ac75-f48f41e85f91 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:52.959812 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a6111938-9c7f-4857-ac75-f48f41e85f91 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:52.961249 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a6111938-9c7f-4857-ac75-f48f41e85f91 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:53.140583 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a6111938-9c7f-4857-ac75-f48f41e85f91 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:53.148741 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a6111938-9c7f-4857-ac75-f48f41e85f91 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1496 microversion: 2.1 time: 0.210878 Feb 28 10:32:53.149203 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 101/201] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:52 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1496 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:53.665863 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-069ea0ea-5d84-4bf5-85ef-845d6b68a361 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:53.666472 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-069ea0ea-5d84-4bf5-85ef-845d6b68a361 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:53.673950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-069ea0ea-5d84-4bf5-85ef-845d6b68a361 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:53.674405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-069ea0ea-5d84-4bf5-85ef-845d6b68a361 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:53.675216 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-069ea0ea-5d84-4bf5-85ef-845d6b68a361 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:53.675652 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-069ea0ea-5d84-4bf5-85ef-845d6b68a361 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:53.885861 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-069ea0ea-5d84-4bf5-85ef-845d6b68a361 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:53.893821 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-069ea0ea-5d84-4bf5-85ef-845d6b68a361 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.231638 Feb 28 10:32:53.894514 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 101/202] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:53 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:54.180898 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7439e682-b763-4252-ae21-c49c2a732b61 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:54.181412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7439e682-b763-4252-ae21-c49c2a732b61 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:54.190775 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7439e682-b763-4252-ae21-c49c2a732b61 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:54.191157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7439e682-b763-4252-ae21-c49c2a732b61 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:54.191943 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7439e682-b763-4252-ae21-c49c2a732b61 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:54.192369 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7439e682-b763-4252-ae21-c49c2a732b61 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:54.219259 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7439e682-b763-4252-ae21-c49c2a732b61 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:32:54.308781 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7439e682-b763-4252-ae21-c49c2a732b61 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 204 len: 0 microversion: 2.1 time: 0.137481 Feb 28 10:32:54.310044 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 102/203] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:32:54 2022] DELETE /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:32:54.319710 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2980847d-76c5-4685-9b7e-7b5e8efdf5d7 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:54.320788 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2980847d-76c5-4685-9b7e-7b5e8efdf5d7 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:54.328786 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2980847d-76c5-4685-9b7e-7b5e8efdf5d7 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:54.329858 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2980847d-76c5-4685-9b7e-7b5e8efdf5d7 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:54.331594 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2980847d-76c5-4685-9b7e-7b5e8efdf5d7 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:54.332192 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2980847d-76c5-4685-9b7e-7b5e8efdf5d7 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:54.532122 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2980847d-76c5-4685-9b7e-7b5e8efdf5d7 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:54.540257 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2980847d-76c5-4685-9b7e-7b5e8efdf5d7 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1502 microversion: 2.1 time: 0.225685 Feb 28 10:32:54.540876 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 102/204] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:54 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:54.773757 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1d14399b-21bb-4b3f-a322-5385ec31f039 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Action: 'create', calling method: .version_select at 0x7f1c584f2430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-151506927"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:54.911078 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d3eaabb9-122c-467b-88b2-e826ddb483f5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:54.911663 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d3eaabb9-122c-467b-88b2-e826ddb483f5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:54.917503 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d3eaabb9-122c-467b-88b2-e826ddb483f5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:54.917949 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d3eaabb9-122c-467b-88b2-e826ddb483f5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:54.918741 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d3eaabb9-122c-467b-88b2-e826ddb483f5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:54.919175 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d3eaabb9-122c-467b-88b2-e826ddb483f5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:55.062307 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d3eaabb9-122c-467b-88b2-e826ddb483f5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:55.062467 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1d14399b-21bb-4b3f-a322-5385ec31f039 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.397872 Feb 28 10:32:55.063116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 103/205] 10.222.0.21 () {60 vars in 1154 bytes} [Mon Feb 28 10:32:54 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 28 10:32:55.070446 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d3eaabb9-122c-467b-88b2-e826ddb483f5 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.163254 Feb 28 10:32:55.071074 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 103/206] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:54 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:55.073557 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-32e4f8d4-a3dd-4292-ad1f-6b3e9de0b525 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c58623dc0>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:55.122694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-32e4f8d4-a3dd-4292-ad1f-6b3e9de0b525 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da" status: 200 len: 344 microversion: 2.1 time: 0.052202 Feb 28 10:32:55.123297 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 104/207] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:32:55 2022] GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:32:55.557091 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-cd4ee0ea-6b7c-4fa1-a090-514546f23cf8 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:55.557701 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-cd4ee0ea-6b7c-4fa1-a090-514546f23cf8 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:55.564422 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cd4ee0ea-6b7c-4fa1-a090-514546f23cf8 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:55.564870 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cd4ee0ea-6b7c-4fa1-a090-514546f23cf8 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:55.565650 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cd4ee0ea-6b7c-4fa1-a090-514546f23cf8 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:55.566088 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cd4ee0ea-6b7c-4fa1-a090-514546f23cf8 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:55.699962 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-cd4ee0ea-6b7c-4fa1-a090-514546f23cf8 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:55.707635 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-cd4ee0ea-6b7c-4fa1-a090-514546f23cf8 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1502 microversion: 2.1 time: 0.154381 Feb 28 10:32:55.708197 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 104/208] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:55 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:56.088554 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b4ece199-6988-47f0-b9c0-6b9df30165e6 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:56.089197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b4ece199-6988-47f0-b9c0-6b9df30165e6 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:56.095800 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b4ece199-6988-47f0-b9c0-6b9df30165e6 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:56.096242 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b4ece199-6988-47f0-b9c0-6b9df30165e6 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:56.097014 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b4ece199-6988-47f0-b9c0-6b9df30165e6 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:56.097444 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b4ece199-6988-47f0-b9c0-6b9df30165e6 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:56.134934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7b6ab64d-58b7-4ba9-8a4f-ac84ee5a3dad tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c5858dc10>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:56.181815 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7b6ab64d-58b7-4ba9-8a4f-ac84ee5a3dad tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da" status: 200 len: 344 microversion: 2.1 time: 0.050269 Feb 28 10:32:56.182664 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 105/209] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:32:56 2022] GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:32:56.232499 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b4ece199-6988-47f0-b9c0-6b9df30165e6 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:56.239763 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b4ece199-6988-47f0-b9c0-6b9df30165e6 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.155799 Feb 28 10:32:56.240320 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 105/210] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:56 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:56.725116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3d1abdfd-2c34-425e-a831-ae309c998fd0 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:56.725717 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3d1abdfd-2c34-425e-a831-ae309c998fd0 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:56.732321 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d1abdfd-2c34-425e-a831-ae309c998fd0 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:56.732892 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d1abdfd-2c34-425e-a831-ae309c998fd0 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:56.733666 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d1abdfd-2c34-425e-a831-ae309c998fd0 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:56.734099 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d1abdfd-2c34-425e-a831-ae309c998fd0 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:56.867924 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3d1abdfd-2c34-425e-a831-ae309c998fd0 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:56.875894 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3d1abdfd-2c34-425e-a831-ae309c998fd0 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1502 microversion: 2.1 time: 0.154597 Feb 28 10:32:56.876457 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 106/211] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:56 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:57.194803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-de21be04-c20a-43d6-a376-108f6586be86 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584cc430>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:57.239977 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-de21be04-c20a-43d6-a376-108f6586be86 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da" status: 200 len: 344 microversion: 2.1 time: 0.049105 Feb 28 10:32:57.240528 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 106/212] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:32:57 2022] GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:57.256463 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-127fb2b5-0223-45d1-8ed9-d033d2c56e52 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:57.257074 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-127fb2b5-0223-45d1-8ed9-d033d2c56e52 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:57.263141 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-127fb2b5-0223-45d1-8ed9-d033d2c56e52 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:57.263593 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-127fb2b5-0223-45d1-8ed9-d033d2c56e52 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:57.264369 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-127fb2b5-0223-45d1-8ed9-d033d2c56e52 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:57.264806 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-127fb2b5-0223-45d1-8ed9-d033d2c56e52 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:57.397870 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-127fb2b5-0223-45d1-8ed9-d033d2c56e52 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:57.405877 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-127fb2b5-0223-45d1-8ed9-d033d2c56e52 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.153214 Feb 28 10:32:57.406438 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 107/213] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:57 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:57.892324 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c1721db0-b11a-4ed2-8dd4-1ea711c45626 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:57.892931 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c1721db0-b11a-4ed2-8dd4-1ea711c45626 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:57.898758 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1721db0-b11a-4ed2-8dd4-1ea711c45626 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:57.899209 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1721db0-b11a-4ed2-8dd4-1ea711c45626 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:57.899980 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1721db0-b11a-4ed2-8dd4-1ea711c45626 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:57.900415 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1721db0-b11a-4ed2-8dd4-1ea711c45626 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:58.038396 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c1721db0-b11a-4ed2-8dd4-1ea711c45626 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:58.047117 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c1721db0-b11a-4ed2-8dd4-1ea711c45626 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1502 microversion: 2.1 time: 0.158817 Feb 28 10:32:58.047685 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 107/214] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:57 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:58.252425 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-fe459bb1-d8dd-44e3-b64a-5a11b6ad413d tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c585b45e0>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:58.299225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-fe459bb1-d8dd-44e3-b64a-5a11b6ad413d tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da" status: 200 len: 345 microversion: 2.1 time: 0.050652 Feb 28 10:32:58.300508 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 108/215] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:32:58 2022] GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:32:58.312084 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1c78933e-072d-44a1-a2e2-e913030cb09c tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Action: 'create', calling method: .version_select at 0x7f1c5851ce50>, body: {"snapshot": {"volume_id": "beb2e2b6-5ff3-4613-a5b3-0d08e01e48da", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1677036548"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:58.422301 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-708333d6-bc7b-4143-a87e-fdf5f611323b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:58.423398 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-708333d6-bc7b-4143-a87e-fdf5f611323b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:58.430147 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-708333d6-bc7b-4143-a87e-fdf5f611323b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:58.430915 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-708333d6-bc7b-4143-a87e-fdf5f611323b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:58.431908 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-708333d6-bc7b-4143-a87e-fdf5f611323b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:58.432350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-708333d6-bc7b-4143-a87e-fdf5f611323b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:58.476785 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1c78933e-072d-44a1-a2e2-e913030cb09c tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.169024 Feb 28 10:32:58.477402 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 108/216] 10.222.0.21 () {60 vars in 1161 bytes} [Mon Feb 28 10:32:58 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:58.491948 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1c740ffb-d915-46cb-8c95-773f405489bf tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584cc1f0>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:58.522893 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1c740ffb-d915-46cb-8c95-773f405489bf tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70" status: 200 len: 287 microversion: 2.1 time: 0.038554 Feb 28 10:32:58.523447 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 109/217] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 10:32:58 2022] GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:32:58.533882 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-af62865f-df7e-40c9-8e95-e691b69af14e tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584ccb80>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:58.564246 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-af62865f-df7e-40c9-8e95-e691b69af14e tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034136 Feb 28 10:32:58.564810 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 110/218] 10.222.0.21 () {58 vars in 1139 bytes} [Mon Feb 28 10:32:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:32:58.574702 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f697b54e-dad6-4580-8544-2ea81b00d3ee tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584cc790>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:58.604789 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f697b54e-dad6-4580-8544-2ea81b00d3ee tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70" status: 200 len: 287 microversion: 2.1 time: 0.033827 Feb 28 10:32:58.605362 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 111/219] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 10:32:58 2022] GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:32:58.687282 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-708333d6-bc7b-4143-a87e-fdf5f611323b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:58.695240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-708333d6-bc7b-4143-a87e-fdf5f611323b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.276906 Feb 28 10:32:58.695880 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 109/220] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:58 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:32:58.848411 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-7216b965-6981-4c5a-9319-e4d79d15d5c3 req-dc5e568a-3b31-4e91-aa4e-0fffb3e60e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df83f9d-01d6-4425-bd1e-202578b5e093", "name": "network-vif-deleted", "tag": "f26e2946-1a0c-4bc6-b5f7-fd4f3bc7a664"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:32:58.857688 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-7216b965-6981-4c5a-9319-e4d79d15d5c3 req-dc5e568a-3b31-4e91-aa4e-0fffb3e60e71 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:58.858780 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-7216b965-6981-4c5a-9319-e4d79d15d5c3 req-dc5e568a-3b31-4e91-aa4e-0fffb3e60e71 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:58.869076 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-7216b965-6981-4c5a-9319-e4d79d15d5c3 req-dc5e568a-3b31-4e91-aa4e-0fffb3e60e71 service nova] Creating event network-vif-deleted:f26e2946-1a0c-4bc6-b5f7-fd4f3bc7a664 for instance 6df83f9d-01d6-4425-bd1e-202578b5e093 on hv-cinder-maste Feb 28 10:32:58.873880 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-7216b965-6981-4c5a-9319-e4d79d15d5c3 req-dc5e568a-3b31-4e91-aa4e-0fffb3e60e71 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029146 Feb 28 10:32:58.874725 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 112/221] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:59.063690 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b0dd8e94-f287-475c-97be-4d58f0807c13 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:59.064297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b0dd8e94-f287-475c-97be-4d58f0807c13 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:59.070021 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b0dd8e94-f287-475c-97be-4d58f0807c13 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:59.070471 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b0dd8e94-f287-475c-97be-4d58f0807c13 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:59.071441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b0dd8e94-f287-475c-97be-4d58f0807c13 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:59.071878 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b0dd8e94-f287-475c-97be-4d58f0807c13 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:59.135281 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b0dd8e94-f287-475c-97be-4d58f0807c13 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:59.143634 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b0dd8e94-f287-475c-97be-4d58f0807c13 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1460 microversion: 2.1 time: 0.084482 Feb 28 10:32:59.144198 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 110/222] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:59 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1460 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:32:59.617396 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e914e591-20db-4cb4-a130-3951277a271c tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584ccf70>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:59.648638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e914e591-20db-4cb4-a130-3951277a271c tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70" status: 200 len: 287 microversion: 2.1 time: 0.036016 Feb 28 10:32:59.649188 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 113/223] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 10:32:59 2022] GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:32:59.713525 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-80916cd0-3bff-4f87-92de-4ad8473af9fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:32:59.714130 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-80916cd0-3bff-4f87-92de-4ad8473af9fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:32:59.720598 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-80916cd0-3bff-4f87-92de-4ad8473af9fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:59.721043 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-80916cd0-3bff-4f87-92de-4ad8473af9fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:59.721810 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-80916cd0-3bff-4f87-92de-4ad8473af9fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:32:59.722240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-80916cd0-3bff-4f87-92de-4ad8473af9fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:32:59.855290 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-80916cd0-3bff-4f87-92de-4ad8473af9fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:32:59.863304 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-80916cd0-3bff-4f87-92de-4ad8473af9fe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.153878 Feb 28 10:32:59.863862 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 111/224] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:32:59 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:00.160146 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3f6bad1a-b396-41a1-992f-e8952d67ac57 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:00.160872 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3f6bad1a-b396-41a1-992f-e8952d67ac57 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:00.167154 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3f6bad1a-b396-41a1-992f-e8952d67ac57 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:00.167628 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3f6bad1a-b396-41a1-992f-e8952d67ac57 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:00.168407 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3f6bad1a-b396-41a1-992f-e8952d67ac57 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:00.168839 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3f6bad1a-b396-41a1-992f-e8952d67ac57 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:00.229683 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3f6bad1a-b396-41a1-992f-e8952d67ac57 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:00.237588 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3f6bad1a-b396-41a1-992f-e8952d67ac57 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1460 microversion: 2.1 time: 0.081291 Feb 28 10:33:00.238150 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 114/225] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:00 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1460 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:00.660675 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-135704fa-da05-49ad-a481-5c9ca0157308 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c5858d1f0>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:00.688311 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-135704fa-da05-49ad-a481-5c9ca0157308 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70" status: 200 len: 287 microversion: 2.1 time: 0.031493 Feb 28 10:33:00.688860 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 112/226] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 10:33:00 2022] GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:33:00.880544 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-838cb14c-e516-4bf1-be95-59c1f1f902ad tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:00.881150 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-838cb14c-e516-4bf1-be95-59c1f1f902ad tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:00.888195 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-838cb14c-e516-4bf1-be95-59c1f1f902ad tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:00.888759 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-838cb14c-e516-4bf1-be95-59c1f1f902ad tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:00.889533 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-838cb14c-e516-4bf1-be95-59c1f1f902ad tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:00.889994 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-838cb14c-e516-4bf1-be95-59c1f1f902ad tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:01.023383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-838cb14c-e516-4bf1-be95-59c1f1f902ad tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:01.030881 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-838cb14c-e516-4bf1-be95-59c1f1f902ad tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.154197 Feb 28 10:33:01.031445 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 115/227] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:00 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:01.254426 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a916ca35-b868-41f2-95cf-4b018632854c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:01.255009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a916ca35-b868-41f2-95cf-4b018632854c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:01.260915 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a916ca35-b868-41f2-95cf-4b018632854c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:01.261367 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a916ca35-b868-41f2-95cf-4b018632854c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:01.262124 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a916ca35-b868-41f2-95cf-4b018632854c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:01.262562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a916ca35-b868-41f2-95cf-4b018632854c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:01.323389 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a916ca35-b868-41f2-95cf-4b018632854c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:01.331104 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a916ca35-b868-41f2-95cf-4b018632854c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 200 len: 1298 microversion: 2.1 time: 0.080537 Feb 28 10:33:01.331725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 113/228] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:01 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 1298 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:01.699860 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-abd9e204-4820-4d67-b17a-7c668f9dea56 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584f2b80>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:01.728119 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-abd9e204-4820-4d67-b17a-7c668f9dea56 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70" status: 200 len: 287 microversion: 2.1 time: 0.032140 Feb 28 10:33:01.728672 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 116/229] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 10:33:01 2022] GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:33:02.048097 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-019aae62-3aac-42d3-88a5-a588e1cb27c8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:02.048838 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-019aae62-3aac-42d3-88a5-a588e1cb27c8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:02.054754 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-019aae62-3aac-42d3-88a5-a588e1cb27c8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:02.055211 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-019aae62-3aac-42d3-88a5-a588e1cb27c8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:02.055998 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-019aae62-3aac-42d3-88a5-a588e1cb27c8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:02.056432 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-019aae62-3aac-42d3-88a5-a588e1cb27c8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:02.193907 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-019aae62-3aac-42d3-88a5-a588e1cb27c8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:02.201379 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-019aae62-3aac-42d3-88a5-a588e1cb27c8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.157795 Feb 28 10:33:02.201951 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 114/230] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:02 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:02.348485 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9282d1dc-a904-49c6-b041-b9107f758feb tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:02.349087 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9282d1dc-a904-49c6-b041-b9107f758feb tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 6df83f9d-01d6-4425-bd1e-202578b5e093] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:02.354986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9282d1dc-a904-49c6-b041-b9107f758feb tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:02.355429 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9282d1dc-a904-49c6-b041-b9107f758feb tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:02.356192 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9282d1dc-a904-49c6-b041-b9107f758feb tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:02.357636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9282d1dc-a904-49c6-b041-b9107f758feb tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:02.370522 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-9282d1dc-a904-49c6-b041-b9107f758feb tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] HTTP exception thrown: Instance 6df83f9d-01d6-4425-bd1e-202578b5e093 could not be found. Feb 28 10:33:02.371133 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9282d1dc-a904-49c6-b041-b9107f758feb tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Returning 404 to user: Instance 6df83f9d-01d6-4425-bd1e-202578b5e093 could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:33:02.371938 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9282d1dc-a904-49c6-b041-b9107f758feb tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093" status: 404 len: 111 microversion: 2.1 time: 0.028147 Feb 28 10:33:02.373684 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 117/231] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:02 2022] GET /compute/v2.1/servers/6df83f9d-01d6-4425-bd1e-202578b5e093 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:33:02.473421 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1000837525", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "networks": [{"uuid": "53295920-84a0-4ffa-9aa6-cb61ab488d09"}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:02.527513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] validate_networks() for [('53295920-84a0-4ffa-9aa6-cb61ab488d09', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:33:02.740545 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-39ffd64a-3b97-4a17-98a8-da793fc85883 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584f29d0>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:02.769471 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-39ffd64a-3b97-4a17-98a8-da793fc85883 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70" status: 200 len: 288 microversion: 2.1 time: 0.032805 Feb 28 10:33:02.770037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 118/232] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 10:33:02 2022] GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70 => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:33:02.780303 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a6ec8fc3-e7bb-4660-ae3d-d6758c6a62d3 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584ccf70>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:02.835991 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a6ec8fc3-e7bb-4660-ae3d-d6758c6a62d3 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "DELETE /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70" status: 202 len: 0 microversion: 2.1 time: 0.059597 Feb 28 10:33:02.836702 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 119/233] 10.222.0.21 () {58 vars in 1253 bytes} [Mon Feb 28 10:33:02 2022] DELETE /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 28 10:33:02.845482 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-596db3b8-d8a0-45bc-8736-57f1cd714174 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c5851ce50>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:02.875436 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-596db3b8-d8a0-45bc-8736-57f1cd714174 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70" status: 200 len: 287 microversion: 2.1 time: 0.034398 Feb 28 10:33:02.876131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 120/234] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 10:33:02 2022] GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:33:02.885976 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:33:02.885976 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:33:02.885976 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:33:02.886387 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:33:02.886857 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:33:02.896349 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:02.896793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:02.897637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:02.898106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:02.915947 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Getting quotas for project 6098811200df4998b4c983c44640d16f. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:33:02.919915 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Getting quotas for user 2c32548c092048afaf0a89eaccdc05cd and project 6098811200df4998b4c983c44640d16f. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:33:02.930453 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:33:02.932732 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:33:02.978407 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-774dadfa-abf9-4aeb-b245-78e70628dd96 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508827 Feb 28 10:33:02.979082 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 115/235] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:33:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:33:02.989970 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-aad99532-dd1c-498f-977e-ba73751bb537 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:02.990647 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-aad99532-dd1c-498f-977e-ba73751bb537 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:03.045112 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-aad99532-dd1c-498f-977e-ba73751bb537 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:03.054128 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-aad99532-dd1c-498f-977e-ba73751bb537 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1214 microversion: 2.1 time: 0.068021 Feb 28 10:33:03.064397 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 121/236] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:02 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:33:03.218997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8b213009-7af3-4ae1-89c8-5e22e173e4fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:03.219650 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8b213009-7af3-4ae1-89c8-5e22e173e4fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:03.233373 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8b213009-7af3-4ae1-89c8-5e22e173e4fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:03.233837 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8b213009-7af3-4ae1-89c8-5e22e173e4fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:03.234666 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8b213009-7af3-4ae1-89c8-5e22e173e4fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:03.235113 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8b213009-7af3-4ae1-89c8-5e22e173e4fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:03.387074 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8b213009-7af3-4ae1-89c8-5e22e173e4fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:03.394968 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8b213009-7af3-4ae1-89c8-5e22e173e4fa tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.180505 Feb 28 10:33:03.395528 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 116/237] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:03 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:03.886989 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-be30ff69-dad6-40c6-b3a3-22c2471f8568 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584f28b0>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:03.911362 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-be30ff69-dad6-40c6-b3a3-22c2471f8568 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] HTTP exception thrown: Snapshot 46e4f256-15ff-49ff-9807-fabf4b4cab70 could not be found. Feb 28 10:33:03.912026 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-be30ff69-dad6-40c6-b3a3-22c2471f8568 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Returning 404 to user: Snapshot 46e4f256-15ff-49ff-9807-fabf4b4cab70 could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:33:03.912964 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-be30ff69-dad6-40c6-b3a3-22c2471f8568 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70" status: 404 len: 111 microversion: 2.1 time: 0.029862 Feb 28 10:33:03.913604 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 122/238] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 10:33:03 2022] GET /compute/v2.1/os-snapshots/46e4f256-15ff-49ff-9807-fabf4b4cab70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:33:03.922591 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6d07d524-d646-460c-bee9-3a7fac9dc54b tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c5858d550>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:03.984710 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6d07d524-d646-460c-bee9-3a7fac9dc54b tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da" status: 202 len: 0 microversion: 2.1 time: 0.066427 Feb 28 10:33:03.986000 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 117/239] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 10:33:03 2022] DELETE /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:33:03.994939 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d906f277-81e4-429f-a204-ce1e918c61d5 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c5851c790>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:04.044976 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d906f277-81e4-429f-a204-ce1e918c61d5 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da" status: 200 len: 344 microversion: 2.1 time: 0.054036 Feb 28 10:33:04.045562 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 123/240] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:33:03 2022] GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:33:04.070939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4393c246-6b3e-4dc8-8227-79956b2b6721 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:04.071552 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4393c246-6b3e-4dc8-8227-79956b2b6721 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:04.077867 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4393c246-6b3e-4dc8-8227-79956b2b6721 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:04.078261 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4393c246-6b3e-4dc8-8227-79956b2b6721 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:04.079204 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4393c246-6b3e-4dc8-8227-79956b2b6721 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:04.079639 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4393c246-6b3e-4dc8-8227-79956b2b6721 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:04.144834 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4393c246-6b3e-4dc8-8227-79956b2b6721 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:04.154158 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4393c246-6b3e-4dc8-8227-79956b2b6721 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1274 microversion: 2.1 time: 0.086455 Feb 28 10:33:04.154820 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 118/241] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:04 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:04.411361 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ea85a596-4ece-4711-864f-f650d2c04b66 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:04.412253 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ea85a596-4ece-4711-864f-f650d2c04b66 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:04.419446 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea85a596-4ece-4711-864f-f650d2c04b66 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:04.420577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea85a596-4ece-4711-864f-f650d2c04b66 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:04.421524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea85a596-4ece-4711-864f-f650d2c04b66 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:04.422501 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea85a596-4ece-4711-864f-f650d2c04b66 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:04.897368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ea85a596-4ece-4711-864f-f650d2c04b66 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:04.907454 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ea85a596-4ece-4711-864f-f650d2c04b66 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.499749 Feb 28 10:33:04.908265 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 124/242] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:04 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:05.059434 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b96e419e-2339-4531-bcef-f64265585979 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c5858d1f0>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:05.094557 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-b96e419e-2339-4531-bcef-f64265585979 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] HTTP exception thrown: Volume beb2e2b6-5ff3-4613-a5b3-0d08e01e48da could not be found. Feb 28 10:33:05.098279 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b96e419e-2339-4531-bcef-f64265585979 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Returning 404 to user: Volume beb2e2b6-5ff3-4613-a5b3-0d08e01e48da could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:33:05.099313 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b96e419e-2339-4531-bcef-f64265585979 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da" status: 404 len: 109 microversion: 2.1 time: 0.045907 Feb 28 10:33:05.099863 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 119/243] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:33:05 2022] GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 10:33:05.115506 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-30cc9ffc-79fc-4d46-bab7-0ca92f335e99 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584e4a60>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:05.159886 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-30cc9ffc-79fc-4d46-bab7-0ca92f335e99 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] HTTP exception thrown: Volume beb2e2b6-5ff3-4613-a5b3-0d08e01e48da could not be found. Feb 28 10:33:05.164313 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-30cc9ffc-79fc-4d46-bab7-0ca92f335e99 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Returning 404 to user: Volume beb2e2b6-5ff3-4613-a5b3-0d08e01e48da could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:33:05.165840 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-30cc9ffc-79fc-4d46-bab7-0ca92f335e99 tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da" status: 404 len: 109 microversion: 2.1 time: 0.054574 Feb 28 10:33:05.171095 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 125/244] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 10:33:05 2022] DELETE /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:33:05.173487 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-817e1b14-ee70-4a90-af04-2fd04b181184 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:05.174103 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-817e1b14-ee70-4a90-af04-2fd04b181184 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:05.176381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-aca05421-b592-4aa3-beb1-dd6bd267fbdc tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Calling method '.version_select at 0x7f1c584f2310>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:05.188856 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-817e1b14-ee70-4a90-af04-2fd04b181184 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:05.189721 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-817e1b14-ee70-4a90-af04-2fd04b181184 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:05.190692 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-817e1b14-ee70-4a90-af04-2fd04b181184 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:05.191302 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-817e1b14-ee70-4a90-af04-2fd04b181184 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:05.212383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-aca05421-b592-4aa3-beb1-dd6bd267fbdc tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] HTTP exception thrown: Volume beb2e2b6-5ff3-4613-a5b3-0d08e01e48da could not be found. Feb 28 10:33:05.213327 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-aca05421-b592-4aa3-beb1-dd6bd267fbdc tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] Returning 404 to user: Volume beb2e2b6-5ff3-4613-a5b3-0d08e01e48da could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:33:05.214412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-aca05421-b592-4aa3-beb1-dd6bd267fbdc tempest-VolumesSnapshotsTestJSON-1011621775 tempest-VolumesSnapshotsTestJSON-1011621775-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da" status: 404 len: 109 microversion: 2.1 time: 0.042201 Feb 28 10:33:05.215163 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 126/245] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 10:33:05 2022] GET /compute/v2.1/os-volumes/beb2e2b6-5ff3-4613-a5b3-0d08e01e48da => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:33:05.496008 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-817e1b14-ee70-4a90-af04-2fd04b181184 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:05.509985 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-817e1b14-ee70-4a90-af04-2fd04b181184 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1314 microversion: 2.1 time: 0.340128 Feb 28 10:33:05.510745 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 120/246] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:05 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:05.929292 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b31ed69b-786d-43e4-9c0a-b7c7bcb402b8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:05.930183 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b31ed69b-786d-43e4-9c0a-b7c7bcb402b8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:05.942172 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b31ed69b-786d-43e4-9c0a-b7c7bcb402b8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:05.942967 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b31ed69b-786d-43e4-9c0a-b7c7bcb402b8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:05.944165 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b31ed69b-786d-43e4-9c0a-b7c7bcb402b8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:05.945446 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b31ed69b-786d-43e4-9c0a-b7c7bcb402b8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:06.135706 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-8022a973-9108-4cd2-846d-44b95e289360 req-67a9ba50-428d-44e5-ba80-54cfacd83e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374e61c8-196c-4960-af98-58277f8f0fcd", "tag": "de92c2f6-ff05-4a7e-b400-87bed5ba8b70"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:06.150051 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-8022a973-9108-4cd2-846d-44b95e289360 req-67a9ba50-428d-44e5-ba80-54cfacd83e6c service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:06.150626 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-8022a973-9108-4cd2-846d-44b95e289360 req-67a9ba50-428d-44e5-ba80-54cfacd83e6c service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:06.164596 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-8022a973-9108-4cd2-846d-44b95e289360 req-67a9ba50-428d-44e5-ba80-54cfacd83e6c service nova] Creating event network-changed:de92c2f6-ff05-4a7e-b400-87bed5ba8b70 for instance 374e61c8-196c-4960-af98-58277f8f0fcd on hv-cinder-maste Feb 28 10:33:06.171612 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-8022a973-9108-4cd2-846d-44b95e289360 req-67a9ba50-428d-44e5-ba80-54cfacd83e6c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043240 Feb 28 10:33:06.172459 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 121/247] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:33:06.304683 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b31ed69b-786d-43e4-9c0a-b7c7bcb402b8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:06.327452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b31ed69b-786d-43e4-9c0a-b7c7bcb402b8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.402666 Feb 28 10:33:06.339007 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 127/248] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:05 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:06.530493 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0ff72f2d-bb98-48cd-97cc-90d8425ac8ce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:06.531352 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0ff72f2d-bb98-48cd-97cc-90d8425ac8ce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:06.553850 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0ff72f2d-bb98-48cd-97cc-90d8425ac8ce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:06.554437 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0ff72f2d-bb98-48cd-97cc-90d8425ac8ce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:06.556826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0ff72f2d-bb98-48cd-97cc-90d8425ac8ce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:06.557667 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0ff72f2d-bb98-48cd-97cc-90d8425ac8ce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:06.791954 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0ff72f2d-bb98-48cd-97cc-90d8425ac8ce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:06.804256 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0ff72f2d-bb98-48cd-97cc-90d8425ac8ce tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1314 microversion: 2.1 time: 0.279931 Feb 28 10:33:06.804837 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 122/249] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:06 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:07.345157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-60715fe2-fced-4125-af61-9f7ce158d347 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:07.345756 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-60715fe2-fced-4125-af61-9f7ce158d347 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:07.353948 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-60715fe2-fced-4125-af61-9f7ce158d347 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:07.354803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-60715fe2-fced-4125-af61-9f7ce158d347 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:07.355687 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-60715fe2-fced-4125-af61-9f7ce158d347 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:07.356335 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-60715fe2-fced-4125-af61-9f7ce158d347 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:07.521215 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-60715fe2-fced-4125-af61-9f7ce158d347 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:07.529440 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-60715fe2-fced-4125-af61-9f7ce158d347 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.188073 Feb 28 10:33:07.530010 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 128/250] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:07 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:07.821256 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-752af78c-7938-485d-9b89-ba4029e08940 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:07.821855 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-752af78c-7938-485d-9b89-ba4029e08940 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:07.830059 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-752af78c-7938-485d-9b89-ba4029e08940 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:07.830737 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-752af78c-7938-485d-9b89-ba4029e08940 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:07.831712 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-752af78c-7938-485d-9b89-ba4029e08940 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:07.832323 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-752af78c-7938-485d-9b89-ba4029e08940 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:08.049271 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-752af78c-7938-485d-9b89-ba4029e08940 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:08.096986 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-752af78c-7938-485d-9b89-ba4029e08940 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1314 microversion: 2.1 time: 0.279655 Feb 28 10:33:08.099564 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 123/251] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:07 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:08.547708 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c799dd76-7dcf-496a-9fcb-8d7821ac7d8a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:08.548439 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c799dd76-7dcf-496a-9fcb-8d7821ac7d8a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:08.554961 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c799dd76-7dcf-496a-9fcb-8d7821ac7d8a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:08.555403 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c799dd76-7dcf-496a-9fcb-8d7821ac7d8a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:08.556315 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c799dd76-7dcf-496a-9fcb-8d7821ac7d8a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:08.556750 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c799dd76-7dcf-496a-9fcb-8d7821ac7d8a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:08.699322 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c799dd76-7dcf-496a-9fcb-8d7821ac7d8a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:08.707958 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c799dd76-7dcf-496a-9fcb-8d7821ac7d8a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.165475 Feb 28 10:33:08.708517 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 129/252] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:08 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:09.118532 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7599b4fd-4d24-45f9-b0e6-0642375d32dc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:09.119203 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7599b4fd-4d24-45f9-b0e6-0642375d32dc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:09.126896 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7599b4fd-4d24-45f9-b0e6-0642375d32dc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:09.127357 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7599b4fd-4d24-45f9-b0e6-0642375d32dc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:09.128144 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7599b4fd-4d24-45f9-b0e6-0642375d32dc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:09.128583 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7599b4fd-4d24-45f9-b0e6-0642375d32dc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:09.276752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7599b4fd-4d24-45f9-b0e6-0642375d32dc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:09.283984 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7599b4fd-4d24-45f9-b0e6-0642375d32dc tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1314 microversion: 2.1 time: 0.170275 Feb 28 10:33:09.284549 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 124/253] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:09 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:09.725992 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-480496d8-b11a-483f-8527-1f29b7eb3912 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:09.727289 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-480496d8-b11a-483f-8527-1f29b7eb3912 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:09.734048 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-480496d8-b11a-483f-8527-1f29b7eb3912 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:09.734500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-480496d8-b11a-483f-8527-1f29b7eb3912 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:09.735338 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-480496d8-b11a-483f-8527-1f29b7eb3912 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:09.735775 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-480496d8-b11a-483f-8527-1f29b7eb3912 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:09.912882 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-480496d8-b11a-483f-8527-1f29b7eb3912 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:09.921709 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-480496d8-b11a-483f-8527-1f29b7eb3912 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.200001 Feb 28 10:33:09.922296 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 130/254] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:09 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:10.300980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a8744702-a276-4bf2-a572-dbba3bd6476e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:10.301593 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a8744702-a276-4bf2-a572-dbba3bd6476e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:10.307822 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a8744702-a276-4bf2-a572-dbba3bd6476e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:10.308270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a8744702-a276-4bf2-a572-dbba3bd6476e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:10.309052 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a8744702-a276-4bf2-a572-dbba3bd6476e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:10.309525 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a8744702-a276-4bf2-a572-dbba3bd6476e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:10.453673 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a8744702-a276-4bf2-a572-dbba3bd6476e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:10.461993 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a8744702-a276-4bf2-a572-dbba3bd6476e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1314 microversion: 2.1 time: 0.164805 Feb 28 10:33:10.462563 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 125/255] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:10 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:10.939871 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4ee13ff4-53c4-453f-a7f9-385120a091f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:10.940483 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4ee13ff4-53c4-453f-a7f9-385120a091f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:10.946852 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ee13ff4-53c4-453f-a7f9-385120a091f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:10.947302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ee13ff4-53c4-453f-a7f9-385120a091f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:10.948080 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ee13ff4-53c4-453f-a7f9-385120a091f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:10.948510 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ee13ff4-53c4-453f-a7f9-385120a091f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:11.094376 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4ee13ff4-53c4-453f-a7f9-385120a091f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:11.101717 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4ee13ff4-53c4-453f-a7f9-385120a091f0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.167026 Feb 28 10:33:11.102277 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 131/256] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:10 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:11.479297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-68453fb1-55e8-452b-909f-0a4ee838233e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:11.480057 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-68453fb1-55e8-452b-909f-0a4ee838233e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:11.486811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-68453fb1-55e8-452b-909f-0a4ee838233e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:11.487475 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-68453fb1-55e8-452b-909f-0a4ee838233e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:11.488421 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-68453fb1-55e8-452b-909f-0a4ee838233e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:11.489068 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-68453fb1-55e8-452b-909f-0a4ee838233e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:11.664668 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-68453fb1-55e8-452b-909f-0a4ee838233e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:11.672863 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-68453fb1-55e8-452b-909f-0a4ee838233e tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1314 microversion: 2.1 time: 0.197783 Feb 28 10:33:11.673654 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 126/257] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:11 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:33:11.796578 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-5ad9961c-8170-4e65-812d-ee7f4a14dc44 req-598fdafc-2ca0-414f-9423-49bed79896b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e61c8-196c-4960-af98-58277f8f0fcd", "name": "network-vif-plugged", "status": "completed", "tag": "de92c2f6-ff05-4a7e-b400-87bed5ba8b70"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:11.806108 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-5ad9961c-8170-4e65-812d-ee7f4a14dc44 req-598fdafc-2ca0-414f-9423-49bed79896b8 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:11.806763 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-5ad9961c-8170-4e65-812d-ee7f4a14dc44 req-598fdafc-2ca0-414f-9423-49bed79896b8 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:11.824175 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-5ad9961c-8170-4e65-812d-ee7f4a14dc44 req-598fdafc-2ca0-414f-9423-49bed79896b8 service nova] Creating event network-vif-plugged:de92c2f6-ff05-4a7e-b400-87bed5ba8b70 for instance 374e61c8-196c-4960-af98-58277f8f0fcd on hv-cinder-maste Feb 28 10:33:11.829499 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-5ad9961c-8170-4e65-812d-ee7f4a14dc44 req-598fdafc-2ca0-414f-9423-49bed79896b8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037672 Feb 28 10:33:11.830289 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 132/258] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:33:12.119185 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-cf78cd80-642c-4cc0-bf8f-a956038185fd tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:12.119795 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-cf78cd80-642c-4cc0-bf8f-a956038185fd tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:12.126781 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cf78cd80-642c-4cc0-bf8f-a956038185fd tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:12.127236 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cf78cd80-642c-4cc0-bf8f-a956038185fd tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:12.128300 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cf78cd80-642c-4cc0-bf8f-a956038185fd tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:12.128638 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cf78cd80-642c-4cc0-bf8f-a956038185fd tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:12.271924 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-cf78cd80-642c-4cc0-bf8f-a956038185fd tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:12.280673 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-cf78cd80-642c-4cc0-bf8f-a956038185fd tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.165368 Feb 28 10:33:12.281500 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 127/259] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:12 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:12.698916 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-29775cfe-9ded-4cc4-9e02-09823d35e054 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:12.699629 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-29775cfe-9ded-4cc4-9e02-09823d35e054 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:12.707269 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29775cfe-9ded-4cc4-9e02-09823d35e054 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:12.707722 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29775cfe-9ded-4cc4-9e02-09823d35e054 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:12.708534 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29775cfe-9ded-4cc4-9e02-09823d35e054 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:12.708996 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-29775cfe-9ded-4cc4-9e02-09823d35e054 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:12.850519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-29775cfe-9ded-4cc4-9e02-09823d35e054 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:12.858761 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-29775cfe-9ded-4cc4-9e02-09823d35e054 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1314 microversion: 2.1 time: 0.163831 Feb 28 10:33:12.860485 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 133/260] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:12 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:13.299370 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-65674776-a95a-438e-80a5-a303b690f251 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:13.299971 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-65674776-a95a-438e-80a5-a303b690f251 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:13.305763 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-65674776-a95a-438e-80a5-a303b690f251 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:13.306207 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-65674776-a95a-438e-80a5-a303b690f251 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:13.307006 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-65674776-a95a-438e-80a5-a303b690f251 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:13.307436 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-65674776-a95a-438e-80a5-a303b690f251 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:13.437136 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-65674776-a95a-438e-80a5-a303b690f251 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:13.444258 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-65674776-a95a-438e-80a5-a303b690f251 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.149266 Feb 28 10:33:13.444812 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 128/261] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:13 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:13.876705 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-48a8f206-6f3f-4430-9bda-e61d7f516f7c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:13.877325 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-48a8f206-6f3f-4430-9bda-e61d7f516f7c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:13.883600 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48a8f206-6f3f-4430-9bda-e61d7f516f7c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:13.884052 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48a8f206-6f3f-4430-9bda-e61d7f516f7c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:13.884830 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48a8f206-6f3f-4430-9bda-e61d7f516f7c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:13.885269 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-48a8f206-6f3f-4430-9bda-e61d7f516f7c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:14.017898 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-48a8f206-6f3f-4430-9bda-e61d7f516f7c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:14.025081 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-48a8f206-6f3f-4430-9bda-e61d7f516f7c tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1314 microversion: 2.1 time: 0.152306 Feb 28 10:33:14.025650 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 134/262] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:13 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:33:14.461510 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-12d82cdb-53b0-4a4b-ae95-bb54bbac3d40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:14.462113 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-12d82cdb-53b0-4a4b-ae95-bb54bbac3d40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:14.468637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-12d82cdb-53b0-4a4b-ae95-bb54bbac3d40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:14.469326 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-12d82cdb-53b0-4a4b-ae95-bb54bbac3d40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:14.470085 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-12d82cdb-53b0-4a4b-ae95-bb54bbac3d40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:14.470520 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-12d82cdb-53b0-4a4b-ae95-bb54bbac3d40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:14.609043 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-12d82cdb-53b0-4a4b-ae95-bb54bbac3d40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:14.616307 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-12d82cdb-53b0-4a4b-ae95-bb54bbac3d40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.158861 Feb 28 10:33:14.616870 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 129/263] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:14 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:15.042510 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-68a34094-0a2b-4ddd-b16c-8362d6fd6299 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:15.043175 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-68a34094-0a2b-4ddd-b16c-8362d6fd6299 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:15.049899 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-68a34094-0a2b-4ddd-b16c-8362d6fd6299 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:15.050339 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-68a34094-0a2b-4ddd-b16c-8362d6fd6299 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:15.051144 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-68a34094-0a2b-4ddd-b16c-8362d6fd6299 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:15.051576 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-68a34094-0a2b-4ddd-b16c-8362d6fd6299 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:15.190137 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-68a34094-0a2b-4ddd-b16c-8362d6fd6299 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:15.197669 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-68a34094-0a2b-4ddd-b16c-8362d6fd6299 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1314 microversion: 2.1 time: 0.158993 Feb 28 10:33:15.198316 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 135/264] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:15 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:15.634424 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f9608dc1-638b-4d45-a8b7-81a6f5c593da tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:15.635052 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f9608dc1-638b-4d45-a8b7-81a6f5c593da tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:15.641615 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9608dc1-638b-4d45-a8b7-81a6f5c593da tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:15.642060 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9608dc1-638b-4d45-a8b7-81a6f5c593da tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:15.642876 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9608dc1-638b-4d45-a8b7-81a6f5c593da tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:15.643308 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9608dc1-638b-4d45-a8b7-81a6f5c593da tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:15.780574 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f9608dc1-638b-4d45-a8b7-81a6f5c593da tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:15.787848 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f9608dc1-638b-4d45-a8b7-81a6f5c593da tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.157406 Feb 28 10:33:15.788414 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 130/265] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:15 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:16.215242 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7842fe56-f32f-4525-b3fd-157c4e596240 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:16.217092 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7842fe56-f32f-4525-b3fd-157c4e596240 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:16.223446 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7842fe56-f32f-4525-b3fd-157c4e596240 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:16.223895 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7842fe56-f32f-4525-b3fd-157c4e596240 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:16.224740 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7842fe56-f32f-4525-b3fd-157c4e596240 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:16.225231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7842fe56-f32f-4525-b3fd-157c4e596240 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:16.415430 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7842fe56-f32f-4525-b3fd-157c4e596240 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:16.423135 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7842fe56-f32f-4525-b3fd-157c4e596240 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1497 microversion: 2.1 time: 0.212104 Feb 28 10:33:16.423706 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 136/266] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:16 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1497 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:16.804768 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c3e74fb7-a49e-4105-8bb8-5651d52eed43 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:16.805501 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c3e74fb7-a49e-4105-8bb8-5651d52eed43 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:16.812185 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3e74fb7-a49e-4105-8bb8-5651d52eed43 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:16.812712 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3e74fb7-a49e-4105-8bb8-5651d52eed43 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:16.813598 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3e74fb7-a49e-4105-8bb8-5651d52eed43 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:16.814105 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3e74fb7-a49e-4105-8bb8-5651d52eed43 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:16.974745 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c3e74fb7-a49e-4105-8bb8-5651d52eed43 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:16.985666 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c3e74fb7-a49e-4105-8bb8-5651d52eed43 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1521 microversion: 2.1 time: 0.184800 Feb 28 10:33:16.986482 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 131/267] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:16 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:17.022980 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3b7f94b8-3e8f-4543-8efd-2aec3a1b72ba tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:17.023487 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3b7f94b8-3e8f-4543-8efd-2aec3a1b72ba tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:17.029621 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3b7f94b8-3e8f-4543-8efd-2aec3a1b72ba tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:17.030068 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3b7f94b8-3e8f-4543-8efd-2aec3a1b72ba tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:17.030945 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3b7f94b8-3e8f-4543-8efd-2aec3a1b72ba tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:17.031379 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3b7f94b8-3e8f-4543-8efd-2aec3a1b72ba tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:17.055802 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3b7f94b8-3e8f-4543-8efd-2aec3a1b72ba tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:33:17.146920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3b7f94b8-3e8f-4543-8efd-2aec3a1b72ba tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "DELETE /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 204 len: 0 microversion: 2.1 time: 0.125976 Feb 28 10:33:17.146920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 137/268] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:33:17 2022] DELETE /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:33:17.155203 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-fdb53ee1-f4d5-4d98-91d3-03e38485b6b2 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:17.155929 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-fdb53ee1-f4d5-4d98-91d3-03e38485b6b2 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:17.173283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fdb53ee1-f4d5-4d98-91d3-03e38485b6b2 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:17.173745 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fdb53ee1-f4d5-4d98-91d3-03e38485b6b2 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:17.176536 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fdb53ee1-f4d5-4d98-91d3-03e38485b6b2 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:17.176944 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fdb53ee1-f4d5-4d98-91d3-03e38485b6b2 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:17.359708 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fdb53ee1-f4d5-4d98-91d3-03e38485b6b2 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:17.371942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-fdb53ee1-f4d5-4d98-91d3-03e38485b6b2 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1503 microversion: 2.1 time: 0.221052 Feb 28 10:33:17.373717 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 132/269] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:17 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:18.002936 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-352dd7f5-455a-4a98-837c-58a65f7c0c1c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:18.003811 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-352dd7f5-455a-4a98-837c-58a65f7c0c1c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:18.014908 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-352dd7f5-455a-4a98-837c-58a65f7c0c1c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:18.015410 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-352dd7f5-455a-4a98-837c-58a65f7c0c1c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:18.016233 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-352dd7f5-455a-4a98-837c-58a65f7c0c1c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:18.016666 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-352dd7f5-455a-4a98-837c-58a65f7c0c1c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:18.171318 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-352dd7f5-455a-4a98-837c-58a65f7c0c1c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:18.178629 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-352dd7f5-455a-4a98-837c-58a65f7c0c1c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1501 microversion: 2.1 time: 0.179787 Feb 28 10:33:18.179162 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 138/270] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:17 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:33:18.197202 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4383deaf-ef7b-41d7-856a-620e58685a13 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:18.197571 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4383deaf-ef7b-41d7-856a-620e58685a13 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:18.203823 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4383deaf-ef7b-41d7-856a-620e58685a13 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:18.204278 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4383deaf-ef7b-41d7-856a-620e58685a13 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:18.205104 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4383deaf-ef7b-41d7-856a-620e58685a13 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:18.205545 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4383deaf-ef7b-41d7-856a-620e58685a13 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:18.348216 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4383deaf-ef7b-41d7-856a-620e58685a13 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:18.356411 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4383deaf-ef7b-41d7-856a-620e58685a13 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1516 microversion: 2.1 time: 0.164871 Feb 28 10:33:18.356981 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 133/271] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:18 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:18.395086 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4e39b158-06a9-4916-98e3-9d54a52bd2db tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:18.395885 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4e39b158-06a9-4916-98e3-9d54a52bd2db tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:18.402143 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4e39b158-06a9-4916-98e3-9d54a52bd2db tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:18.402617 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4e39b158-06a9-4916-98e3-9d54a52bd2db tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:18.403690 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4e39b158-06a9-4916-98e3-9d54a52bd2db tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:18.404243 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4e39b158-06a9-4916-98e3-9d54a52bd2db tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:18.600131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4e39b158-06a9-4916-98e3-9d54a52bd2db tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:18.607824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4e39b158-06a9-4916-98e3-9d54a52bd2db tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1503 microversion: 2.1 time: 0.221243 Feb 28 10:33:18.608678 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 139/272] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:18 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:19.628944 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-525c5ee9-1d70-4c3a-be89-753167300166 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:19.629582 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-525c5ee9-1d70-4c3a-be89-753167300166 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:19.636123 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-525c5ee9-1d70-4c3a-be89-753167300166 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:19.636568 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-525c5ee9-1d70-4c3a-be89-753167300166 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:19.639306 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-525c5ee9-1d70-4c3a-be89-753167300166 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:19.639757 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-525c5ee9-1d70-4c3a-be89-753167300166 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:19.880814 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7ad15c18-81ed-4b0a-9025-92e5c7f5dc40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:19.882478 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7ad15c18-81ed-4b0a-9025-92e5c7f5dc40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:19.893991 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-525c5ee9-1d70-4c3a-be89-753167300166 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c32548c092048afaf0a89eaccdc05cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6098811200df4998b4c983c44640d16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:19.899556 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7ad15c18-81ed-4b0a-9025-92e5c7f5dc40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:19.900387 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7ad15c18-81ed-4b0a-9025-92e5c7f5dc40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:19.901599 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7ad15c18-81ed-4b0a-9025-92e5c7f5dc40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:19.902272 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7ad15c18-81ed-4b0a-9025-92e5c7f5dc40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:19.905847 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-525c5ee9-1d70-4c3a-be89-753167300166 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 200 len: 1503 microversion: 2.1 time: 0.283672 Feb 28 10:33:19.906439 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 134/273] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:19 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 1503 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:19.945816 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-7ad15c18-81ed-4b0a-9025-92e5c7f5dc40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lazy-loading 'flavor' on Instance uuid e1560b32-2ab2-4234-aeca-5cbe2d745915 {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:33:20.085401 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7ad15c18-81ed-4b0a-9025-92e5c7f5dc40 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/action" status: 200 len: 32 microversion: 2.1 time: 0.208599 Feb 28 10:33:20.086335 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 140/274] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:33:19 2022] POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 28 10:33:20.095949 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-02a6b78b-e9b3-41b3-9674-4fff5dc46477 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:20.097039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-02a6b78b-e9b3-41b3-9674-4fff5dc46477 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:20.104685 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-02a6b78b-e9b3-41b3-9674-4fff5dc46477 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:20.105220 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-02a6b78b-e9b3-41b3-9674-4fff5dc46477 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:20.106021 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-02a6b78b-e9b3-41b3-9674-4fff5dc46477 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:20.106590 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-02a6b78b-e9b3-41b3-9674-4fff5dc46477 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:20.213748 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-99909f88-32a0-4d07-9b15-feaa415735c3 req-5c2c6188-eba9-4360-a0bd-c24704f45093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e61c8-196c-4960-af98-58277f8f0fcd", "name": "network-vif-deleted", "tag": "de92c2f6-ff05-4a7e-b400-87bed5ba8b70"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:20.244630 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-99909f88-32a0-4d07-9b15-feaa415735c3 req-5c2c6188-eba9-4360-a0bd-c24704f45093 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:20.247472 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-99909f88-32a0-4d07-9b15-feaa415735c3 req-5c2c6188-eba9-4360-a0bd-c24704f45093 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:20.260654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-99909f88-32a0-4d07-9b15-feaa415735c3 req-5c2c6188-eba9-4360-a0bd-c24704f45093 service nova] Creating event network-vif-deleted:de92c2f6-ff05-4a7e-b400-87bed5ba8b70 for instance 374e61c8-196c-4960-af98-58277f8f0fcd on hv-cinder-maste Feb 28 10:33:20.266428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-99909f88-32a0-4d07-9b15-feaa415735c3 req-5c2c6188-eba9-4360-a0bd-c24704f45093 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059500 Feb 28 10:33:20.267499 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 141/275] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:33:20.401711 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-02a6b78b-e9b3-41b3-9674-4fff5dc46477 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:20.409256 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-02a6b78b-e9b3-41b3-9674-4fff5dc46477 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.317147 Feb 28 10:33:20.410634 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 135/276] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:20 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:20.924248 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0dd4894d-a8ff-4d9e-a199-5046739993d5 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:20.925694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0dd4894d-a8ff-4d9e-a199-5046739993d5 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] [instance: 374e61c8-196c-4960-af98-58277f8f0fcd] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:20.931971 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0dd4894d-a8ff-4d9e-a199-5046739993d5 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:20.932473 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0dd4894d-a8ff-4d9e-a199-5046739993d5 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:20.933666 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0dd4894d-a8ff-4d9e-a199-5046739993d5 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:20.934201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0dd4894d-a8ff-4d9e-a199-5046739993d5 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:20.957991 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-0dd4894d-a8ff-4d9e-a199-5046739993d5 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] HTTP exception thrown: Instance 374e61c8-196c-4960-af98-58277f8f0fcd could not be found. Feb 28 10:33:20.958737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0dd4894d-a8ff-4d9e-a199-5046739993d5 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] Returning 404 to user: Instance 374e61c8-196c-4960-af98-58277f8f0fcd could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:33:20.959998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0dd4894d-a8ff-4d9e-a199-5046739993d5 tempest-VolumesActionsTest-586676207 tempest-VolumesActionsTest-586676207-project] 10.222.0.21 "GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd" status: 404 len: 111 microversion: 2.1 time: 0.041094 Feb 28 10:33:20.966041 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 142/277] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:20 2022] GET /compute/v2.1/servers/374e61c8-196c-4960-af98-58277f8f0fcd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:33:21.429596 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-bb8a678e-2c07-4582-b9c3-c98478a55f34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:21.430215 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-bb8a678e-2c07-4582-b9c3-c98478a55f34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:21.437406 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bb8a678e-2c07-4582-b9c3-c98478a55f34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:21.437841 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bb8a678e-2c07-4582-b9c3-c98478a55f34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:21.438681 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bb8a678e-2c07-4582-b9c3-c98478a55f34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:21.439285 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bb8a678e-2c07-4582-b9c3-c98478a55f34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:21.643337 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-bb8a678e-2c07-4582-b9c3-c98478a55f34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:21.654822 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-bb8a678e-2c07-4582-b9c3-c98478a55f34 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.227914 Feb 28 10:33:21.658779 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 136/278] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:21 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:22.671789 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0de9d3f6-668b-480c-96e8-b99857e76fec tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:22.672397 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0de9d3f6-668b-480c-96e8-b99857e76fec tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:22.678732 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0de9d3f6-668b-480c-96e8-b99857e76fec tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:22.679173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0de9d3f6-668b-480c-96e8-b99857e76fec tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:22.679944 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0de9d3f6-668b-480c-96e8-b99857e76fec tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:22.680373 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0de9d3f6-668b-480c-96e8-b99857e76fec tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:22.826886 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0de9d3f6-668b-480c-96e8-b99857e76fec tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:22.834126 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0de9d3f6-668b-480c-96e8-b99857e76fec tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.166652 Feb 28 10:33:22.834998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 143/279] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:22 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:23.850739 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-cac7158d-0f1c-49d7-96a5-0d60ed866ab7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:23.851649 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-cac7158d-0f1c-49d7-96a5-0d60ed866ab7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:23.858002 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cac7158d-0f1c-49d7-96a5-0d60ed866ab7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:23.858617 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cac7158d-0f1c-49d7-96a5-0d60ed866ab7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:23.859424 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cac7158d-0f1c-49d7-96a5-0d60ed866ab7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:23.859864 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cac7158d-0f1c-49d7-96a5-0d60ed866ab7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:23.998127 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-cac7158d-0f1c-49d7-96a5-0d60ed866ab7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:24.005388 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-cac7158d-0f1c-49d7-96a5-0d60ed866ab7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.158550 Feb 28 10:33:24.006086 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 137/280] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:23 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:25.022908 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1dadac92-dd7f-48b0-a62e-1eb0678b1d30 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:25.023519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1dadac92-dd7f-48b0-a62e-1eb0678b1d30 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:25.029786 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1dadac92-dd7f-48b0-a62e-1eb0678b1d30 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:25.030232 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1dadac92-dd7f-48b0-a62e-1eb0678b1d30 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:25.031043 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1dadac92-dd7f-48b0-a62e-1eb0678b1d30 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:25.031482 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1dadac92-dd7f-48b0-a62e-1eb0678b1d30 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:25.161664 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1dadac92-dd7f-48b0-a62e-1eb0678b1d30 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:25.169511 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1dadac92-dd7f-48b0-a62e-1eb0678b1d30 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.150288 Feb 28 10:33:25.170109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 144/281] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:25 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:26.186793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-db9633b3-b120-4240-89fb-6690ecbb6425 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:26.187315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-db9633b3-b120-4240-89fb-6690ecbb6425 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:26.193225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-db9633b3-b120-4240-89fb-6690ecbb6425 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:26.193679 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-db9633b3-b120-4240-89fb-6690ecbb6425 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:26.194456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-db9633b3-b120-4240-89fb-6690ecbb6425 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:26.194926 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-db9633b3-b120-4240-89fb-6690ecbb6425 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:26.582309 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-db9633b3-b120-4240-89fb-6690ecbb6425 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:26.591591 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-db9633b3-b120-4240-89fb-6690ecbb6425 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.408218 Feb 28 10:33:26.592324 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 138/282] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:26 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:27.609549 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f174f600-1002-4eb3-86d4-b6c1f743c320 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:27.610179 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f174f600-1002-4eb3-86d4-b6c1f743c320 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:27.616890 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f174f600-1002-4eb3-86d4-b6c1f743c320 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:27.617539 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f174f600-1002-4eb3-86d4-b6c1f743c320 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:27.618379 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f174f600-1002-4eb3-86d4-b6c1f743c320 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:27.619073 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f174f600-1002-4eb3-86d4-b6c1f743c320 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:27.797764 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f174f600-1002-4eb3-86d4-b6c1f743c320 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:27.814932 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f174f600-1002-4eb3-86d4-b6c1f743c320 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.209502 Feb 28 10:33:27.816176 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 145/283] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:27 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:28.832062 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ba425ea1-d212-4f91-abce-20b8f76b7f24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:28.832694 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ba425ea1-d212-4f91-abce-20b8f76b7f24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:28.838762 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ba425ea1-d212-4f91-abce-20b8f76b7f24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:28.839222 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ba425ea1-d212-4f91-abce-20b8f76b7f24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:28.840009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ba425ea1-d212-4f91-abce-20b8f76b7f24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:28.840449 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ba425ea1-d212-4f91-abce-20b8f76b7f24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:28.974241 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ba425ea1-d212-4f91-abce-20b8f76b7f24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:28.981442 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ba425ea1-d212-4f91-abce-20b8f76b7f24 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.153283 Feb 28 10:33:28.982192 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 139/284] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:28 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:29.998434 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c4be1a10-2967-4957-ac44-5df43fcfa63b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:29.999070 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c4be1a10-2967-4957-ac44-5df43fcfa63b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:30.005926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c4be1a10-2967-4957-ac44-5df43fcfa63b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:30.006379 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c4be1a10-2967-4957-ac44-5df43fcfa63b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:30.007206 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c4be1a10-2967-4957-ac44-5df43fcfa63b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:30.007644 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c4be1a10-2967-4957-ac44-5df43fcfa63b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:30.148255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c4be1a10-2967-4957-ac44-5df43fcfa63b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:30.157689 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c4be1a10-2967-4957-ac44-5df43fcfa63b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.163216 Feb 28 10:33:30.158328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 146/285] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:29 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:31.175670 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c60454dd-9264-4d03-8d06-e258fad616ab tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:31.177691 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c60454dd-9264-4d03-8d06-e258fad616ab tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:31.184240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c60454dd-9264-4d03-8d06-e258fad616ab tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:31.184797 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c60454dd-9264-4d03-8d06-e258fad616ab tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:31.185594 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c60454dd-9264-4d03-8d06-e258fad616ab tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:31.186061 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c60454dd-9264-4d03-8d06-e258fad616ab tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:31.320950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c60454dd-9264-4d03-8d06-e258fad616ab tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:31.328695 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c60454dd-9264-4d03-8d06-e258fad616ab tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.156847 Feb 28 10:33:31.329278 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 140/286] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:31 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:32.346640 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0df7a2d9-c3a1-4282-9279-69240feb342c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:32.347239 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0df7a2d9-c3a1-4282-9279-69240feb342c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:32.353505 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0df7a2d9-c3a1-4282-9279-69240feb342c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:32.353920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0df7a2d9-c3a1-4282-9279-69240feb342c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:32.354725 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0df7a2d9-c3a1-4282-9279-69240feb342c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:32.355162 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0df7a2d9-c3a1-4282-9279-69240feb342c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:32.489925 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0df7a2d9-c3a1-4282-9279-69240feb342c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:32.497255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0df7a2d9-c3a1-4282-9279-69240feb342c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.154396 Feb 28 10:33:32.497986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 147/287] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:32 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:33.514885 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5ec56fb6-ebc0-43fd-bc30-2985ec80304c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:33.515502 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5ec56fb6-ebc0-43fd-bc30-2985ec80304c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:33.521426 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ec56fb6-ebc0-43fd-bc30-2985ec80304c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:33.521882 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ec56fb6-ebc0-43fd-bc30-2985ec80304c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:33.522698 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ec56fb6-ebc0-43fd-bc30-2985ec80304c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:33.523144 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ec56fb6-ebc0-43fd-bc30-2985ec80304c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:33.655405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5ec56fb6-ebc0-43fd-bc30-2985ec80304c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:33.662625 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5ec56fb6-ebc0-43fd-bc30-2985ec80304c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.152348 Feb 28 10:33:33.663196 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 141/288] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:33 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:34.679870 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-12f53aeb-6aa2-43e8-8dbf-3aee1b050e81 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:34.681571 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-12f53aeb-6aa2-43e8-8dbf-3aee1b050e81 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:34.690229 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-12f53aeb-6aa2-43e8-8dbf-3aee1b050e81 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:34.691136 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-12f53aeb-6aa2-43e8-8dbf-3aee1b050e81 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:34.692565 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-12f53aeb-6aa2-43e8-8dbf-3aee1b050e81 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:34.693508 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-12f53aeb-6aa2-43e8-8dbf-3aee1b050e81 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:35.010643 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-12f53aeb-6aa2-43e8-8dbf-3aee1b050e81 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:35.022504 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-12f53aeb-6aa2-43e8-8dbf-3aee1b050e81 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.346499 Feb 28 10:33:35.023529 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 148/289] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:34 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:35.243247 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-37b20af5-f071-48de-9510-e976d5236017 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:35.245465 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-37b20af5-f071-48de-9510-e976d5236017 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:35.254037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-37b20af5-f071-48de-9510-e976d5236017 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:35.254825 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-37b20af5-f071-48de-9510-e976d5236017 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:35.255808 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-37b20af5-f071-48de-9510-e976d5236017 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:35.256394 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-37b20af5-f071-48de-9510-e976d5236017 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:35.288388 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-37b20af5-f071-48de-9510-e976d5236017 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lazy-loading 'flavor' on Instance uuid 1ead279e-e2e9-4312-a47a-fbec064ce99b {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:33:35.572103 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-37b20af5-f071-48de-9510-e976d5236017 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/action" status: 202 len: 0 microversion: 2.20 time: 0.333308 Feb 28 10:33:35.576199 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 142/290] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Feb 28 10:33:35 2022] POST /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:33:35.581672 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:35.582520 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:35.589508 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:35.590303 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:35.592231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:35.592916 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:35.769146 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:35.777746 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:35.779744 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:35.781142 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-74edec01-e389-4ead-a87e-bc456bd3f33f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.203581 Feb 28 10:33:35.781886 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 149/291] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:35 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:36.041493 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-bbc434cb-e5cb-4025-99e0-baccee14438b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:36.042359 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-bbc434cb-e5cb-4025-99e0-baccee14438b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:36.049606 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bbc434cb-e5cb-4025-99e0-baccee14438b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:36.050312 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bbc434cb-e5cb-4025-99e0-baccee14438b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:36.062942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bbc434cb-e5cb-4025-99e0-baccee14438b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:36.063472 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bbc434cb-e5cb-4025-99e0-baccee14438b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:36.292171 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-bbc434cb-e5cb-4025-99e0-baccee14438b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:36.303166 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-bbc434cb-e5cb-4025-99e0-baccee14438b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.265805 Feb 28 10:33:36.305254 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 143/292] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:36 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:36.802139 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:36.802777 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:36.809193 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:36.810407 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:36.812630 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:36.813075 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:36.971334 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:36.979518 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:36.981046 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:36.982842 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-52c9661e-199d-4e71-a2e5-96324a1ae7d4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.184538 Feb 28 10:33:36.983697 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 150/293] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:36 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:37.323302 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-edd44b08-62ee-4712-9bd4-2721ebb68af9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:37.323923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-edd44b08-62ee-4712-9bd4-2721ebb68af9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:37.331244 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-edd44b08-62ee-4712-9bd4-2721ebb68af9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:37.331921 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-edd44b08-62ee-4712-9bd4-2721ebb68af9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:37.333101 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-edd44b08-62ee-4712-9bd4-2721ebb68af9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:37.333785 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-edd44b08-62ee-4712-9bd4-2721ebb68af9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:37.475049 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-edd44b08-62ee-4712-9bd4-2721ebb68af9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:37.484173 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-edd44b08-62ee-4712-9bd4-2721ebb68af9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.165171 Feb 28 10:33:37.484944 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 144/294] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:37 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:38.001278 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:38.002428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:38.009500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:38.010127 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:38.011104 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:38.011701 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:38.152903 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:38.162156 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:38.163701 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:38.164849 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-83f2ec66-873c-4856-b5ab-caf4fae85493 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.167508 Feb 28 10:33:38.165468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 151/295] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:37 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:38.501416 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-166c58f8-5a32-4a3a-8d22-d2c7251ccb00 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:38.502032 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-166c58f8-5a32-4a3a-8d22-d2c7251ccb00 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:38.507849 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-166c58f8-5a32-4a3a-8d22-d2c7251ccb00 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:38.508299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-166c58f8-5a32-4a3a-8d22-d2c7251ccb00 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:38.509079 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-166c58f8-5a32-4a3a-8d22-d2c7251ccb00 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:38.509514 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-166c58f8-5a32-4a3a-8d22-d2c7251ccb00 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:38.655132 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-166c58f8-5a32-4a3a-8d22-d2c7251ccb00 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:38.662499 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-166c58f8-5a32-4a3a-8d22-d2c7251ccb00 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.165164 Feb 28 10:33:38.663085 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 145/296] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:38 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:39.183646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:39.184452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:39.191560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:39.192004 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:39.192786 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:39.193224 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:39.329826 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:39.337639 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:39.339216 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:39.340270 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-beae8fd8-6bab-4a74-bae8-a75f237653a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.160495 Feb 28 10:33:39.341394 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 152/297] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:39 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:33:39.682370 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7cc98cc9-ff45-4de0-8df3-04ffbeade7e8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:39.683111 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7cc98cc9-ff45-4de0-8df3-04ffbeade7e8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:39.690166 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7cc98cc9-ff45-4de0-8df3-04ffbeade7e8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:39.690781 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7cc98cc9-ff45-4de0-8df3-04ffbeade7e8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:39.691610 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7cc98cc9-ff45-4de0-8df3-04ffbeade7e8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:39.692054 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7cc98cc9-ff45-4de0-8df3-04ffbeade7e8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:39.909959 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7cc98cc9-ff45-4de0-8df3-04ffbeade7e8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:39.917471 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7cc98cc9-ff45-4de0-8df3-04ffbeade7e8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.239613 Feb 28 10:33:39.918045 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 146/298] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:39 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:40.361706 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:40.362330 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:40.378326 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:40.382643 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:40.386911 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:40.389451 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:40.710300 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:40.720966 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:40.728473 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:40.729951 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-84519511-05f3-4930-8343-aef545af6c41 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.374167 Feb 28 10:33:40.735710 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 153/299] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:40 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:40.819234 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-55957e2c-2fee-4c3c-bac9-5444b4da0573 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c173e195-abdf-4568-bbc2-63003d486c2a"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:40.819234 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-55957e2c-2fee-4c3c-bac9-5444b4da0573 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:40.849242 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-55957e2c-2fee-4c3c-bac9-5444b4da0573 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:40.849444 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-55957e2c-2fee-4c3c-bac9-5444b4da0573 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:40.861295 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-55957e2c-2fee-4c3c-bac9-5444b4da0573 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:40.862441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-55957e2c-2fee-4c3c-bac9-5444b4da0573 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:40.945309 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-04809275-09b1-45be-bcfb-e0f7dec367d0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:40.946293 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-04809275-09b1-45be-bcfb-e0f7dec367d0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:40.961946 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-04809275-09b1-45be-bcfb-e0f7dec367d0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:40.962760 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-04809275-09b1-45be-bcfb-e0f7dec367d0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:40.963868 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-04809275-09b1-45be-bcfb-e0f7dec367d0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:40.964463 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-04809275-09b1-45be-bcfb-e0f7dec367d0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:41.175907 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-04809275-09b1-45be-bcfb-e0f7dec367d0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:41.186249 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-04809275-09b1-45be-bcfb-e0f7dec367d0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1502 microversion: 2.1 time: 0.245241 Feb 28 10:33:41.187244 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 154/300] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:40 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:41.210489 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-74cb05a6-733c-4435-8e1e-0f3127baa63d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e5b2080-fa65-4a86-af5a-3f561f5f7faf"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:41.212043 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-74cb05a6-733c-4435-8e1e-0f3127baa63d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:41.218638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74cb05a6-733c-4435-8e1e-0f3127baa63d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:41.219092 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74cb05a6-733c-4435-8e1e-0f3127baa63d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:41.220033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74cb05a6-733c-4435-8e1e-0f3127baa63d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:41.220475 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74cb05a6-733c-4435-8e1e-0f3127baa63d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:41.229318 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-55957e2c-2fee-4c3c-bac9-5444b4da0573 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429707 Feb 28 10:33:41.229934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 147/301] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:33:40 2022] POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:33:41.251290 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-74cb05a6-733c-4435-8e1e-0f3127baa63d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] HTTP exception thrown: Cannot 'attach_volume' instance e1560b32-2ab2-4234-aeca-5cbe2d745915 while it is in vm_state rescued Feb 28 10:33:41.252155 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-74cb05a6-733c-4435-8e1e-0f3127baa63d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Returning 409 to user: Cannot 'attach_volume' instance e1560b32-2ab2-4234-aeca-5cbe2d745915 while it is in vm_state rescued {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:33:41.253246 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-74cb05a6-733c-4435-8e1e-0f3127baa63d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048714 Feb 28 10:33:41.257490 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 155/302] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:33:41 2022] POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 28 10:33:41.263873 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-bbff7a1d-82b6-4f70-9585-ff56e8b263a9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:41.264506 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-bbff7a1d-82b6-4f70-9585-ff56e8b263a9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:41.271266 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bbff7a1d-82b6-4f70-9585-ff56e8b263a9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:41.271707 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bbff7a1d-82b6-4f70-9585-ff56e8b263a9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:41.272506 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bbff7a1d-82b6-4f70-9585-ff56e8b263a9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:41.272943 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bbff7a1d-82b6-4f70-9585-ff56e8b263a9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:41.338914 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-bbff7a1d-82b6-4f70-9585-ff56e8b263a9 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/action" status: 202 len: 0 microversion: 2.1 time: 0.079691 Feb 28 10:33:41.339669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 148/303] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:33:41 2022] POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:33:41.348566 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e302ccc7-eddc-4706-9234-4ae5189e1f8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:41.349169 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e302ccc7-eddc-4706-9234-4ae5189e1f8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:41.355089 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e302ccc7-eddc-4706-9234-4ae5189e1f8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:41.355528 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e302ccc7-eddc-4706-9234-4ae5189e1f8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:41.356469 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e302ccc7-eddc-4706-9234-4ae5189e1f8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:41.357187 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e302ccc7-eddc-4706-9234-4ae5189e1f8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:41.491104 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e302ccc7-eddc-4706-9234-4ae5189e1f8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:41.499375 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e302ccc7-eddc-4706-9234-4ae5189e1f8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1510 microversion: 2.1 time: 0.154619 Feb 28 10:33:41.499957 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 156/304] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:41 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:41.755375 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:41.756072 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:41.762557 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:41.763030 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:41.763813 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:41.764250 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:41.905124 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:41.913050 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:41.914571 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:41.915740 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b33afe47-9f4a-44cb-bd80-8fd37a6d587c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.165251 Feb 28 10:33:41.916276 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 149/305] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:41 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:33:42.518339 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1ef0a3a0-e6b7-4ee0-a0b5-2ef0432357b7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:42.518939 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1ef0a3a0-e6b7-4ee0-a0b5-2ef0432357b7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:42.524785 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1ef0a3a0-e6b7-4ee0-a0b5-2ef0432357b7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:42.525235 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1ef0a3a0-e6b7-4ee0-a0b5-2ef0432357b7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:42.526012 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1ef0a3a0-e6b7-4ee0-a0b5-2ef0432357b7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:42.526452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1ef0a3a0-e6b7-4ee0-a0b5-2ef0432357b7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:42.660748 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1ef0a3a0-e6b7-4ee0-a0b5-2ef0432357b7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:42.668084 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1ef0a3a0-e6b7-4ee0-a0b5-2ef0432357b7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1510 microversion: 2.1 time: 0.154172 Feb 28 10:33:42.668655 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 157/306] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:42 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:42.933031 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:42.933655 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:42.940678 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:42.941263 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:42.941934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:42.942376 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:43.077131 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:43.085011 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:43.086793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:43.087922 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-465299d4-5817-44f7-916a-c1ebde0a1e0c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.158771 Feb 28 10:33:43.088475 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 150/307] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:42 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:43.685727 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b49c3771-cca9-467c-aa28-69ac6000d718 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:43.686368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b49c3771-cca9-467c-aa28-69ac6000d718 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:43.693191 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b49c3771-cca9-467c-aa28-69ac6000d718 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:43.693646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b49c3771-cca9-467c-aa28-69ac6000d718 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:43.694430 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b49c3771-cca9-467c-aa28-69ac6000d718 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:43.694903 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b49c3771-cca9-467c-aa28-69ac6000d718 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:43.831580 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b49c3771-cca9-467c-aa28-69ac6000d718 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:43.841302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b49c3771-cca9-467c-aa28-69ac6000d718 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1510 microversion: 2.1 time: 0.159444 Feb 28 10:33:43.842481 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 158/308] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:43 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:44.107063 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:44.107803 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:44.114547 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:44.115315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:44.116304 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:44.116931 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:44.409352 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:44.418119 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:44.420343 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:44.421621 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-cef0990f-610f-421b-aa5a-fb8e041e658d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.318683 Feb 28 10:33:44.433910 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 151/309] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:44 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:44.860744 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b9537dad-0811-4bc9-af12-1ad8e8b8be82 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:44.862118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b9537dad-0811-4bc9-af12-1ad8e8b8be82 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:44.875737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b9537dad-0811-4bc9-af12-1ad8e8b8be82 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:44.876202 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b9537dad-0811-4bc9-af12-1ad8e8b8be82 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:44.877023 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b9537dad-0811-4bc9-af12-1ad8e8b8be82 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:44.877515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b9537dad-0811-4bc9-af12-1ad8e8b8be82 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:45.064537 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b9537dad-0811-4bc9-af12-1ad8e8b8be82 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:45.072473 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b9537dad-0811-4bc9-af12-1ad8e8b8be82 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1510 microversion: 2.1 time: 0.216628 Feb 28 10:33:45.073198 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 159/310] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:44 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:45.440632 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:45.441292 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:45.447613 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:45.448064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:45.449033 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:45.449632 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:45.595642 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:45.603658 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:45.605717 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:45.607233 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c01dd6d1-aa6e-4f62-8a3d-9b0201694cf9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.170412 Feb 28 10:33:45.607795 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 152/311] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:45 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:46.089278 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1bfe4384-b752-4b99-98b6-2b5db90c5bf0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:46.089958 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1bfe4384-b752-4b99-98b6-2b5db90c5bf0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:46.100422 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1bfe4384-b752-4b99-98b6-2b5db90c5bf0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:46.101766 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1bfe4384-b752-4b99-98b6-2b5db90c5bf0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:46.103368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1bfe4384-b752-4b99-98b6-2b5db90c5bf0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:46.104189 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1bfe4384-b752-4b99-98b6-2b5db90c5bf0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:46.263758 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1bfe4384-b752-4b99-98b6-2b5db90c5bf0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:46.272019 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1bfe4384-b752-4b99-98b6-2b5db90c5bf0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1510 microversion: 2.1 time: 0.186649 Feb 28 10:33:46.272593 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 160/312] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:46 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:46.625977 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:46.626588 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:46.632806 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:46.633251 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:46.634026 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:46.634459 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:46.775145 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:46.784545 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:46.786804 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:46.787957 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c904681c-d61c-4c2a-8da2-d94c832954c2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.166569 Feb 28 10:33:46.788899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 153/313] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:46 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:47.289130 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8cc11898-a9f4-4534-ba2d-a9fe179fe823 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:47.289741 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8cc11898-a9f4-4534-ba2d-a9fe179fe823 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:47.299684 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8cc11898-a9f4-4534-ba2d-a9fe179fe823 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:47.300526 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8cc11898-a9f4-4534-ba2d-a9fe179fe823 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:47.302638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8cc11898-a9f4-4534-ba2d-a9fe179fe823 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:47.303385 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8cc11898-a9f4-4534-ba2d-a9fe179fe823 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:47.469037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8cc11898-a9f4-4534-ba2d-a9fe179fe823 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:47.476700 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8cc11898-a9f4-4534-ba2d-a9fe179fe823 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1516 microversion: 2.1 time: 0.191402 Feb 28 10:33:47.477243 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 161/314] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:47 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:47.808005 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:47.808616 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:47.819119 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:47.819801 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:47.821302 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:47.821898 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:47.989958 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:47.999385 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:48.001126 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:48.002648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5ff936a9-a7eb-434c-8581-5e4c49f451ff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.198671 Feb 28 10:33:48.003193 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 154/315] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:47 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:48.894694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b0133017-c9a9-4367-accd-13f68513b35a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:48.896709 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b0133017-c9a9-4367-accd-13f68513b35a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:48.910075 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b0133017-c9a9-4367-accd-13f68513b35a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:48.910845 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b0133017-c9a9-4367-accd-13f68513b35a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:48.912824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b0133017-c9a9-4367-accd-13f68513b35a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:48.913984 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b0133017-c9a9-4367-accd-13f68513b35a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:49.024596 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:49.025505 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:49.033098 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:49.033663 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:49.052950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:49.055221 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:49.115698 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b0133017-c9a9-4367-accd-13f68513b35a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:49.134384 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b0133017-c9a9-4367-accd-13f68513b35a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1516 microversion: 2.1 time: 0.239606 Feb 28 10:33:49.135039 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 162/316] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:48 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:49.158912 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0e21ec2a-742a-4866-aef8-386c5c502bd7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aeeb9e4-b914-4a2e-a36e-4a5eaa6cd2b8"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:49.160664 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0e21ec2a-742a-4866-aef8-386c5c502bd7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:49.171881 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0e21ec2a-742a-4866-aef8-386c5c502bd7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:49.172330 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0e21ec2a-742a-4866-aef8-386c5c502bd7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:49.173132 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0e21ec2a-742a-4866-aef8-386c5c502bd7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:49.173569 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0e21ec2a-742a-4866-aef8-386c5c502bd7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:49.281063 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:49.289104 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:49.290627 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:49.291777 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2b01a30e-595a-45d3-b156-b28a5056af3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.272600 Feb 28 10:33:49.292325 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 155/317] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:49 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:33:49.522199 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0e21ec2a-742a-4866-aef8-386c5c502bd7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372858 Feb 28 10:33:49.523254 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 163/318] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:33:49 2022] POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:33:50.314964 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:50.315690 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:50.323692 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:50.324473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:50.325875 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:50.327077 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:50.595444 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:50.618956 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:50.621232 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:50.622709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-faa31e4e-9eb5-45eb-b542-60937dd8ad43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.314775 Feb 28 10:33:50.631463 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 156/319] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:50 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:51.659108 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:51.660534 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:51.668013 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:51.668891 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:51.670070 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:51.670724 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:52.055999 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:52.066688 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:52.068376 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:52.071252 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-61e83444-7d30-4400-954a-34ad02fa2802 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.420839 Feb 28 10:33:52.084346 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 164/320] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:51 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:53.089652 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:53.090448 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:53.125003 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:53.125478 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:53.127934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:53.129516 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:53.489709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:53.498478 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:53.502058 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:53.503519 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6e52da34-cfe0-4788-bcf5-0795d9263bbf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.418212 Feb 28 10:33:53.504072 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 157/321] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:53 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:54.280919 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ad4db83d-c229-46c2-90a7-4c1ca3dbca12 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:54.302142 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ad4db83d-c229-46c2-90a7-4c1ca3dbca12 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:54.302519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ad4db83d-c229-46c2-90a7-4c1ca3dbca12 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:54.525738 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:54.528799 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:54.549689 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ad4db83d-c229-46c2-90a7-4c1ca3dbca12 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Going to try to stop instance {{(pid=123152) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Feb 28 10:33:54.559826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:54.563976 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:54.573425 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:54.577794 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:54.729396 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ad4db83d-c229-46c2-90a7-4c1ca3dbca12 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/action" status: 202 len: 0 microversion: 2.1 time: 0.452599 Feb 28 10:33:54.738551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 165/322] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:33:54 2022] POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:33:54.775630 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d71ed312-e5f9-404a-9aa4-cd2bd9e2ac06 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:54.777709 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d71ed312-e5f9-404a-9aa4-cd2bd9e2ac06 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:54.797058 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d71ed312-e5f9-404a-9aa4-cd2bd9e2ac06 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:54.797892 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d71ed312-e5f9-404a-9aa4-cd2bd9e2ac06 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:54.798964 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d71ed312-e5f9-404a-9aa4-cd2bd9e2ac06 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:54.799688 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d71ed312-e5f9-404a-9aa4-cd2bd9e2ac06 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:54.932842 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:54.947688 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:54.949556 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:54.956000 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5f67e25f-629e-407e-84d3-47b34c72bf43 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1744 microversion: 2.20 time: 0.438169 Feb 28 10:33:54.956885 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 158/323] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:54 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1744 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:33:55.094457 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d71ed312-e5f9-404a-9aa4-cd2bd9e2ac06 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:55.106706 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d71ed312-e5f9-404a-9aa4-cd2bd9e2ac06 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 0.362776 Feb 28 10:33:55.107341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 166/324] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:54 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:55.978974 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:55.979827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:55.989277 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:55.989725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:55.990524 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:55.990991 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:56.136537 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2c0b527d-d403-4405-9b16-ac84b351cdd0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:56.137189 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2c0b527d-d403-4405-9b16-ac84b351cdd0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:56.155886 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c0b527d-d403-4405-9b16-ac84b351cdd0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:56.156332 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c0b527d-d403-4405-9b16-ac84b351cdd0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:56.167191 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c0b527d-d403-4405-9b16-ac84b351cdd0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:56.167850 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c0b527d-d403-4405-9b16-ac84b351cdd0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:56.620743 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:56.641462 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:56.655430 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:56.659904 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b1b696ed-6de4-47ed-8daf-caf650e4fd9b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1744 microversion: 2.20 time: 0.685379 Feb 28 10:33:56.664076 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 159/325] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:55 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1744 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:56.749602 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2c0b527d-d403-4405-9b16-ac84b351cdd0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:56.761674 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2c0b527d-d403-4405-9b16-ac84b351cdd0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 0.637064 Feb 28 10:33:56.762807 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 167/326] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:56 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:57.698764 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:57.703299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:57.737022 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:57.740344 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:57.745818 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:57.747204 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:57.783153 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-208608e8-b125-4e1d-9550-3355df2d2386 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:57.783807 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-208608e8-b125-4e1d-9550-3355df2d2386 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:57.814167 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-208608e8-b125-4e1d-9550-3355df2d2386 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:57.820391 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-208608e8-b125-4e1d-9550-3355df2d2386 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:57.823236 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-208608e8-b125-4e1d-9550-3355df2d2386 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:57.824259 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-208608e8-b125-4e1d-9550-3355df2d2386 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:58.281474 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:58.291762 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:58.298987 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:58.300586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5e439394-053a-4222-a068-61ba67932136 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 0.619560 Feb 28 10:33:58.318798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 160/327] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:57 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:33:58.570208 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-208608e8-b125-4e1d-9550-3355df2d2386 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:58.584343 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-208608e8-b125-4e1d-9550-3355df2d2386 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 0.808687 Feb 28 10:33:58.590944 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 168/328] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:57 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:33:58.989042 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-0728a266-3cdf-46f7-ab46-989460875cf2 req-6b6cdc93-d37d-4e0f-ae79-4e51ccfb5395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ead279e-e2e9-4312-a47a-fbec064ce99b", "name": "network-vif-plugged", "status": "completed", "tag": "76aed61f-8cd7-4455-a163-d78d7f320a35"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:33:59.012928 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-0728a266-3cdf-46f7-ab46-989460875cf2 req-6b6cdc93-d37d-4e0f-ae79-4e51ccfb5395 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:59.013825 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-0728a266-3cdf-46f7-ab46-989460875cf2 req-6b6cdc93-d37d-4e0f-ae79-4e51ccfb5395 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:59.043114 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-0728a266-3cdf-46f7-ab46-989460875cf2 req-6b6cdc93-d37d-4e0f-ae79-4e51ccfb5395 service nova] Creating event network-vif-plugged:76aed61f-8cd7-4455-a163-d78d7f320a35 for instance 1ead279e-e2e9-4312-a47a-fbec064ce99b on hv-cinder-maste Feb 28 10:33:59.053650 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-0728a266-3cdf-46f7-ab46-989460875cf2 req-6b6cdc93-d37d-4e0f-ae79-4e51ccfb5395 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071155 Feb 28 10:33:59.054940 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 161/329] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:33:59.330323 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:59.332352 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:59.354292 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:59.355050 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:59.357202 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:59.358031 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:59.605136 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f611cdb2-ee3f-46a7-bccc-47b2d1a4c814 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:33:59.605951 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f611cdb2-ee3f-46a7-bccc-47b2d1a4c814 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:33:59.623946 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f611cdb2-ee3f-46a7-bccc-47b2d1a4c814 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:59.627461 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f611cdb2-ee3f-46a7-bccc-47b2d1a4c814 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:59.629958 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f611cdb2-ee3f-46a7-bccc-47b2d1a4c814 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:33:59.631899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f611cdb2-ee3f-46a7-bccc-47b2d1a4c814 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:33:59.768411 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:59.777519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:59.788231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:33:59.801852 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a88bdfa4-a626-4f97-8652-01cc0ff8f853 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 0.477730 Feb 28 10:33:59.807811 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 169/330] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:33:59 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:00.276763 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f611cdb2-ee3f-46a7-bccc-47b2d1a4c814 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:00.306084 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f611cdb2-ee3f-46a7-bccc-47b2d1a4c814 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 0.705667 Feb 28 10:34:00.341404 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 162/331] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:33:59 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:00.827468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:00.828085 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:00.846372 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:00.847809 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:00.853777 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:00.854731 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:01.343573 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-aaabf251-9d74-43b8-ba12-700102d61c1f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:01.345303 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-aaabf251-9d74-43b8-ba12-700102d61c1f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:01.364923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aaabf251-9d74-43b8-ba12-700102d61c1f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:01.366885 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aaabf251-9d74-43b8-ba12-700102d61c1f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:01.377936 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aaabf251-9d74-43b8-ba12-700102d61c1f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:01.378502 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aaabf251-9d74-43b8-ba12-700102d61c1f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:01.601534 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:01.610442 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:01.635452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:01.637075 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ef988dcc-d927-446b-becd-c63bd1f36e71 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 0.815420 Feb 28 10:34:01.643377 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 170/332] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:00 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:02.126106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-aaabf251-9d74-43b8-ba12-700102d61c1f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:02.183845 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-aaabf251-9d74-43b8-ba12-700102d61c1f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 0.844716 Feb 28 10:34:02.202755 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 163/333] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:01 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:02.353425 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4b275cec-bfb0-41e8-8edb-dc87860d0870 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:02.354447 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4b275cec-bfb0-41e8-8edb-dc87860d0870 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:02.373816 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4b275cec-bfb0-41e8-8edb-dc87860d0870 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:02.374268 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4b275cec-bfb0-41e8-8edb-dc87860d0870 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:02.384425 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4b275cec-bfb0-41e8-8edb-dc87860d0870 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:02.384896 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4b275cec-bfb0-41e8-8edb-dc87860d0870 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:02.474161 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-4b275cec-bfb0-41e8-8edb-dc87860d0870 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lazy-loading 'flavor' on Instance uuid e1560b32-2ab2-4234-aeca-5cbe2d745915 {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:34:02.663693 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:02.664312 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:02.678974 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:02.679436 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:02.680243 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:02.697427 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:02.813087 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4b275cec-bfb0-41e8-8edb-dc87860d0870 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/action" status: 200 len: 32 microversion: 2.1 time: 0.463505 Feb 28 10:34:02.814508 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 171/334] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:34:02 2022] POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/action => generated 32 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 10:34:02.849924 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-32877aad-36af-4197-9eb7-1c2e0c211857 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:02.851572 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-32877aad-36af-4197-9eb7-1c2e0c211857 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:02.881835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-32877aad-36af-4197-9eb7-1c2e0c211857 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:02.882205 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-32877aad-36af-4197-9eb7-1c2e0c211857 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:02.883058 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-32877aad-36af-4197-9eb7-1c2e0c211857 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:02.883494 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-32877aad-36af-4197-9eb7-1c2e0c211857 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:04.300240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:04.306090 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-32877aad-36af-4197-9eb7-1c2e0c211857 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:04.316386 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-32877aad-36af-4197-9eb7-1c2e0c211857 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 1.495877 Feb 28 10:34:04.319259 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:04.320872 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 172/335] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:02 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:04.321091 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:04.323600 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f8c7532b-673f-4702-85cc-922b7513cfcd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 1.663867 Feb 28 10:34:04.325922 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 164/336] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:02 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:04.342705 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2ddafd81-cbae-4169-b9e4-95dc6ae7e01d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:04.350500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2ddafd81-cbae-4169-b9e4-95dc6ae7e01d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:04.368505 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2ddafd81-cbae-4169-b9e4-95dc6ae7e01d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:04.370979 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2ddafd81-cbae-4169-b9e4-95dc6ae7e01d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:04.374978 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2ddafd81-cbae-4169-b9e4-95dc6ae7e01d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:04.375979 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2ddafd81-cbae-4169-b9e4-95dc6ae7e01d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:05.338839 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f750db87-22c7-4115-8c7d-5863f01c9f50 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:05.340235 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f750db87-22c7-4115-8c7d-5863f01c9f50 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:05.355914 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f750db87-22c7-4115-8c7d-5863f01c9f50 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:05.362750 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f750db87-22c7-4115-8c7d-5863f01c9f50 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:05.363722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f750db87-22c7-4115-8c7d-5863f01c9f50 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:05.368289 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f750db87-22c7-4115-8c7d-5863f01c9f50 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:05.566651 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2ddafd81-cbae-4169-b9e4-95dc6ae7e01d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:05.601590 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2ddafd81-cbae-4169-b9e4-95dc6ae7e01d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 1.278392 Feb 28 10:34:05.607442 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 173/337] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:04 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:05.666891 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:05.668926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:05.682450 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:05.683269 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:05.685207 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:05.686081 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:06.556697 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f750db87-22c7-4115-8c7d-5863f01c9f50 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:06.567727 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f750db87-22c7-4115-8c7d-5863f01c9f50 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 1.234182 Feb 28 10:34:06.598970 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 165/338] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:05 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:06.626903 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3de2a5c4-466a-4d91-bdc6-affac0e7adc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:06.627527 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3de2a5c4-466a-4d91-bdc6-affac0e7adc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:06.647789 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3de2a5c4-466a-4d91-bdc6-affac0e7adc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:06.651358 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3de2a5c4-466a-4d91-bdc6-affac0e7adc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:06.655639 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3de2a5c4-466a-4d91-bdc6-affac0e7adc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:06.659138 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3de2a5c4-466a-4d91-bdc6-affac0e7adc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:07.006316 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:07.015466 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:07.031036 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:07.032613 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-792b7b68-bf1b-49f4-ab37-c8da16d4ccc6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 1.420647 Feb 28 10:34:07.033326 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 174/339] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:05 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:07.350459 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3de2a5c4-466a-4d91-bdc6-affac0e7adc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:07.368598 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3de2a5c4-466a-4d91-bdc6-affac0e7adc0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 0.740864 Feb 28 10:34:07.369251 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 166/340] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:06 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:07.585323 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-51d53da6-0202-40d6-ba55-63168da049fc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:07.586282 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-51d53da6-0202-40d6-ba55-63168da049fc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:07.600345 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-51d53da6-0202-40d6-ba55-63168da049fc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:07.609020 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-51d53da6-0202-40d6-ba55-63168da049fc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:07.610489 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-51d53da6-0202-40d6-ba55-63168da049fc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:07.615177 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-51d53da6-0202-40d6-ba55-63168da049fc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:08.051283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:08.052098 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:08.057987 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:08.058425 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:08.066592 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:08.068936 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:08.741961 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-51d53da6-0202-40d6-ba55-63168da049fc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:08.777918 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-51d53da6-0202-40d6-ba55-63168da049fc tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 1.195922 Feb 28 10:34:08.788506 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 175/341] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:07 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:08.830714 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d3ce87f5-affd-4b60-b67d-a1b217246bb5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:08.831554 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d3ce87f5-affd-4b60-b67d-a1b217246bb5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:08.870255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d3ce87f5-affd-4b60-b67d-a1b217246bb5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:08.879169 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d3ce87f5-affd-4b60-b67d-a1b217246bb5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:08.880432 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d3ce87f5-affd-4b60-b67d-a1b217246bb5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:08.892889 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d3ce87f5-affd-4b60-b67d-a1b217246bb5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:09.183322 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:09.211557 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:09.220599 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:09.228981 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-de5a26d8-a0e5-4063-a9f6-fb5891ea3bc4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 1.181684 Feb 28 10:34:09.233908 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 167/342] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:08 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:09.420306 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d3ce87f5-affd-4b60-b67d-a1b217246bb5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:09.436717 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d3ce87f5-affd-4b60-b67d-a1b217246bb5 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 0.646463 Feb 28 10:34:09.443077 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 176/343] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:08 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:09.814039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f1894cdb-3459-4921-90f5-16268555885a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:09.815054 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f1894cdb-3459-4921-90f5-16268555885a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:09.832993 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f1894cdb-3459-4921-90f5-16268555885a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:09.835149 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f1894cdb-3459-4921-90f5-16268555885a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:09.836419 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f1894cdb-3459-4921-90f5-16268555885a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:09.839037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f1894cdb-3459-4921-90f5-16268555885a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:10.251533 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:10.252827 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:10.268067 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:10.270768 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:10.273955 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:10.279937 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:10.732428 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f1894cdb-3459-4921-90f5-16268555885a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:10.747766 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f1894cdb-3459-4921-90f5-16268555885a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 0.941408 Feb 28 10:34:10.755760 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 168/344] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:09 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:10.774248 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5a4210a2-9bde-4e38-bbe4-9e5951ade29d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:10.777760 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5a4210a2-9bde-4e38-bbe4-9e5951ade29d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:10.787648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5a4210a2-9bde-4e38-bbe4-9e5951ade29d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:10.788614 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5a4210a2-9bde-4e38-bbe4-9e5951ade29d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:10.790346 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5a4210a2-9bde-4e38-bbe4-9e5951ade29d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:10.791092 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5a4210a2-9bde-4e38-bbe4-9e5951ade29d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:11.584663 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:11.602574 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:11.604695 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:11.605328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7a3b5658-682a-4754-a75f-4bab571d31ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 1.358490 Feb 28 10:34:11.610992 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 177/345] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:10 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:11.773550 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-618c09d0-cf20-441c-950b-9710bab38812 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:11.774169 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-618c09d0-cf20-441c-950b-9710bab38812 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:11.792497 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5a4210a2-9bde-4e38-bbe4-9e5951ade29d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:11.801657 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5a4210a2-9bde-4e38-bbe4-9e5951ade29d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 1.032722 Feb 28 10:34:11.802286 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 169/346] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:10 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:11.803658 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-618c09d0-cf20-441c-950b-9710bab38812 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:11.804104 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-618c09d0-cf20-441c-950b-9710bab38812 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:11.804963 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-618c09d0-cf20-441c-950b-9710bab38812 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:11.805341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-618c09d0-cf20-441c-950b-9710bab38812 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:12.630135 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:12.633051 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:12.647942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:12.648518 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:12.649664 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:12.650361 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:13.080333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-618c09d0-cf20-441c-950b-9710bab38812 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:13.091060 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-618c09d0-cf20-441c-950b-9710bab38812 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 1.320706 Feb 28 10:34:13.106592 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 178/347] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:11 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:13.122535 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-daf87b10-6d73-4e01-98c9-5c30feb20fdc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:13.124715 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-daf87b10-6d73-4e01-98c9-5c30feb20fdc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:13.142225 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-daf87b10-6d73-4e01-98c9-5c30feb20fdc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:13.144166 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-daf87b10-6d73-4e01-98c9-5c30feb20fdc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:13.145686 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-daf87b10-6d73-4e01-98c9-5c30feb20fdc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:13.147520 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-daf87b10-6d73-4e01-98c9-5c30feb20fdc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:13.537797 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:13.549722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:13.551634 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:13.555913 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f6fec936-585c-4a38-8814-97b1b34183a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 0.929786 Feb 28 10:34:13.563506 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 170/348] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:12 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:13.655503 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-daf87b10-6d73-4e01-98c9-5c30feb20fdc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:13.667718 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-daf87b10-6d73-4e01-98c9-5c30feb20fdc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 0.556144 Feb 28 10:34:13.671005 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 179/349] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:13 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:14.114797 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-32f0104d-2ef5-43c8-8af6-92d23a598307 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:14.115506 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-32f0104d-2ef5-43c8-8af6-92d23a598307 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:14.134761 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-32f0104d-2ef5-43c8-8af6-92d23a598307 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:14.137857 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-32f0104d-2ef5-43c8-8af6-92d23a598307 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:14.139271 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-32f0104d-2ef5-43c8-8af6-92d23a598307 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:14.141086 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-32f0104d-2ef5-43c8-8af6-92d23a598307 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:14.581893 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:14.582782 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:14.598308 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:14.598795 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:14.599604 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:14.601694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:15.078186 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-32f0104d-2ef5-43c8-8af6-92d23a598307 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:15.101127 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-32f0104d-2ef5-43c8-8af6-92d23a598307 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 0.992280 Feb 28 10:34:15.118728 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 171/350] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:14 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:15.126137 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0b7e1ac2-c8af-4887-87e6-2d7465ef7e90 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:15.135575 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0b7e1ac2-c8af-4887-87e6-2d7465ef7e90 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:15.160671 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0b7e1ac2-c8af-4887-87e6-2d7465ef7e90 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:15.161939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0b7e1ac2-c8af-4887-87e6-2d7465ef7e90 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:15.167331 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0b7e1ac2-c8af-4887-87e6-2d7465ef7e90 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:15.168593 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0b7e1ac2-c8af-4887-87e6-2d7465ef7e90 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:15.782676 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0b7e1ac2-c8af-4887-87e6-2d7465ef7e90 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:15.793363 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0b7e1ac2-c8af-4887-87e6-2d7465ef7e90 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1724 microversion: 2.1 time: 0.673308 Feb 28 10:34:15.799383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:15.808333 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 172/351] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:15 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1724 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:15.810747 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:15.815111 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:15.819939 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ad51a634-00ed-476d-95b7-32d2dcd04273 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 1.242538 Feb 28 10:34:15.820708 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 180/352] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:14 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:16.121522 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2c9d1ede-1611-4857-a41b-464179b8cb53 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:16.122295 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2c9d1ede-1611-4857-a41b-464179b8cb53 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:16.132421 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ede-1611-4857-a41b-464179b8cb53 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:16.136155 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ede-1611-4857-a41b-464179b8cb53 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:16.137721 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ede-1611-4857-a41b-464179b8cb53 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:16.139037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ede-1611-4857-a41b-464179b8cb53 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:16.314901 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b122db8d-cb6c-4318-8686-c27502823f33 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Action: 'create', calling method: .version_select at 0x7f1c58450670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1600317973"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:16.353904 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-b122db8d-cb6c-4318-8686-c27502823f33 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Getting quotas for project b55c46d5c05b41adb823461813ee1e5b. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:34:16.362705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-b122db8d-cb6c-4318-8686-c27502823f33 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Getting quotas for user 5b21c9002601480eaabdbcb74d337f2a and project b55c46d5c05b41adb823461813ee1e5b. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:34:16.539473 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2c9d1ede-1611-4857-a41b-464179b8cb53 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:16.548220 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2c9d1ede-1611-4857-a41b-464179b8cb53 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 0.432237 Feb 28 10:34:16.565940 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 181/353] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:16 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:16.826018 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-629bb9d6-d036-4ca4-b824-c82d78ad044e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:16.827289 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-629bb9d6-d036-4ca4-b824-c82d78ad044e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:16.845033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-629bb9d6-d036-4ca4-b824-c82d78ad044e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:16.848637 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-629bb9d6-d036-4ca4-b824-c82d78ad044e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:16.854238 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-629bb9d6-d036-4ca4-b824-c82d78ad044e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:16.857595 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-629bb9d6-d036-4ca4-b824-c82d78ad044e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:17.384524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-629bb9d6-d036-4ca4-b824-c82d78ad044e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:17.398479 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-629bb9d6-d036-4ca4-b824-c82d78ad044e tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1701 microversion: 2.1 time: 0.576949 Feb 28 10:34:17.402422 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 182/354] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:16 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1701 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:17.419522 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:17.422989 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:17.444909 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:17.445747 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:17.446824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:17.448888 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:17.844717 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:17.855508 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:17.857160 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:17.867068 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6706f51a-74dd-4e24-a8d9-f866b6d91219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 0.454747 Feb 28 10:34:17.867732 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 183/355] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:17 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:17.888635 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d5840143-92c3-4dc2-a3bd-91a2aecee604 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:17.917492 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d5840143-92c3-4dc2-a3bd-91a2aecee604 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:17.917955 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d5840143-92c3-4dc2-a3bd-91a2aecee604 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:17.999857 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d5840143-92c3-4dc2-a3bd-91a2aecee604 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Going to try to start instance {{(pid=123152) start /opt/stack/nova/nova/compute/api.py:2730}} Feb 28 10:34:18.017860 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-b122db8d-cb6c-4318-8686-c27502823f33 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Getting quotas for project b55c46d5c05b41adb823461813ee1e5b. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:34:18.024792 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-b122db8d-cb6c-4318-8686-c27502823f33 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Getting quotas for user 5b21c9002601480eaabdbcb74d337f2a and project b55c46d5c05b41adb823461813ee1e5b. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:34:18.114329 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b122db8d-cb6c-4318-8686-c27502823f33 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 2.300710 Feb 28 10:34:18.118347 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d5840143-92c3-4dc2-a3bd-91a2aecee604 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/action" status: 202 len: 0 microversion: 2.1 time: 0.237958 Feb 28 10:34:18.119583 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 184/356] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:34:17 2022] POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:34:18.128498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 173/357] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 10:34:15 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:18.131672 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ca493d95-7e31-42a7-9b01-ef423e5f9e1b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:18.132846 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ca493d95-7e31-42a7-9b01-ef423e5f9e1b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:18.147868 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ca493d95-7e31-42a7-9b01-ef423e5f9e1b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:18.149856 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ca493d95-7e31-42a7-9b01-ef423e5f9e1b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:18.150989 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ca493d95-7e31-42a7-9b01-ef423e5f9e1b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:18.154165 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ca493d95-7e31-42a7-9b01-ef423e5f9e1b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:18.156522 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-be875431-4d25-4a47-8dc7-623b25283611 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:18.161683 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-be875431-4d25-4a47-8dc7-623b25283611 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:18.202794 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-be875431-4d25-4a47-8dc7-623b25283611 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:18.204186 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-be875431-4d25-4a47-8dc7-623b25283611 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:18.214213 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-be875431-4d25-4a47-8dc7-623b25283611 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:18.217129 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-be875431-4d25-4a47-8dc7-623b25283611 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:18.859465 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ca493d95-7e31-42a7-9b01-ef423e5f9e1b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:18.876250 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ca493d95-7e31-42a7-9b01-ef423e5f9e1b tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 0.755054 Feb 28 10:34:18.885875 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 185/358] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:18 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:18.892579 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:18.896863 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:18.914790 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:18.915001 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:18.917650 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:18.919231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:19.487248 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-be875431-4d25-4a47-8dc7-623b25283611 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:19.509198 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-be875431-4d25-4a47-8dc7-623b25283611 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1710 microversion: 2.1 time: 1.379511 Feb 28 10:34:19.519603 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 174/359] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:18 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1710 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:19.894150 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f45887ae-956e-495e-be62-800b93699d6a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:19.894962 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f45887ae-956e-495e-be62-800b93699d6a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:19.911744 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f45887ae-956e-495e-be62-800b93699d6a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:19.917315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f45887ae-956e-495e-be62-800b93699d6a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:19.919799 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f45887ae-956e-495e-be62-800b93699d6a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:19.920281 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f45887ae-956e-495e-be62-800b93699d6a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:20.192476 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:20.212126 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:20.219802 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:20.228828 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c90d909b-54e0-4b49-905d-2736eaec57f6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 1.347217 Feb 28 10:34:20.231465 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 186/360] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:18 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:20.537047 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-67da11b9-5263-46f1-8665-309aedc4817d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:20.537712 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-67da11b9-5263-46f1-8665-309aedc4817d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:20.548541 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-67da11b9-5263-46f1-8665-309aedc4817d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:20.550023 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-67da11b9-5263-46f1-8665-309aedc4817d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:20.553255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-67da11b9-5263-46f1-8665-309aedc4817d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:20.554892 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-67da11b9-5263-46f1-8665-309aedc4817d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:21.181777 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f45887ae-956e-495e-be62-800b93699d6a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:21.196776 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f45887ae-956e-495e-be62-800b93699d6a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 1.307013 Feb 28 10:34:21.197302 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 175/361] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:19 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:21.255822 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:21.260420 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:21.289246 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:21.290161 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:21.301971 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:21.302980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:21.820298 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-67da11b9-5263-46f1-8665-309aedc4817d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:21.836303 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-67da11b9-5263-46f1-8665-309aedc4817d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1710 microversion: 2.1 time: 1.302709 Feb 28 10:34:21.841757 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 187/362] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:20 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1710 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:22.149400 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:22.165639 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:22.171789 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:22.178321 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4996f91e-d054-40b0-8a04-dcf5d8e68dcc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 0.933242 Feb 28 10:34:22.189309 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 176/363] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:21 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:22.214735 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-77d4c119-82a1-4d1f-842a-ef617d1dc10d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:22.216636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-77d4c119-82a1-4d1f-842a-ef617d1dc10d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:22.237510 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-77d4c119-82a1-4d1f-842a-ef617d1dc10d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:22.241401 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-77d4c119-82a1-4d1f-842a-ef617d1dc10d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:22.244132 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-77d4c119-82a1-4d1f-842a-ef617d1dc10d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:22.246146 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-77d4c119-82a1-4d1f-842a-ef617d1dc10d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:22.778477 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-77d4c119-82a1-4d1f-842a-ef617d1dc10d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:22.792557 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-77d4c119-82a1-4d1f-842a-ef617d1dc10d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 0.582925 Feb 28 10:34:22.804505 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 188/364] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:22 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:22.869116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3b278d3e-fed5-4f6e-8f38-c55e709049e4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:22.877419 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3b278d3e-fed5-4f6e-8f38-c55e709049e4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:22.901449 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b278d3e-fed5-4f6e-8f38-c55e709049e4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:22.901971 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b278d3e-fed5-4f6e-8f38-c55e709049e4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:22.907590 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b278d3e-fed5-4f6e-8f38-c55e709049e4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:22.909513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b278d3e-fed5-4f6e-8f38-c55e709049e4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:23.211341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:23.212434 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:23.223262 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:23.223791 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:23.232122 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:23.232793 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:23.552237 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3b278d3e-fed5-4f6e-8f38-c55e709049e4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:23.564931 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3b278d3e-fed5-4f6e-8f38-c55e709049e4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1714 microversion: 2.1 time: 0.702224 Feb 28 10:34:23.591012 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 177/365] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:22 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1714 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:23.782912 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:23.791256 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:23.800974 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:23.806406 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-65392754-c488-4c59-885a-67da8d184d14 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 0.599959 Feb 28 10:34:23.807474 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 189/366] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:23 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:23.812186 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-fe82760c-f1cb-495f-a05b-5308016fec7d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:23.816687 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-fe82760c-f1cb-495f-a05b-5308016fec7d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:23.858987 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fe82760c-f1cb-495f-a05b-5308016fec7d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:23.859507 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fe82760c-f1cb-495f-a05b-5308016fec7d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:23.860372 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fe82760c-f1cb-495f-a05b-5308016fec7d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:23.869959 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fe82760c-f1cb-495f-a05b-5308016fec7d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:24.443078 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fe82760c-f1cb-495f-a05b-5308016fec7d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:24.459805 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-fe82760c-f1cb-495f-a05b-5308016fec7d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1568 microversion: 2.1 time: 0.651888 Feb 28 10:34:24.460649 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 178/367] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:23 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1568 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:24.828721 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:24.829546 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:24.866577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:24.868998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:24.872056 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:24.873852 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:24.944987 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1633775208", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:25.538022 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:25.547040 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:25.552381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:25.555395 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c91ba9d7-6724-4d68-96ae-949513e2fcb8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 0.734234 Feb 28 10:34:25.568437 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 190/368] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:24 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:25.573894 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3bcaa68e-83ea-4e14-bb1a-8db3e44e1263 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:25.578371 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3bcaa68e-83ea-4e14-bb1a-8db3e44e1263 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:25.598536 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3bcaa68e-83ea-4e14-bb1a-8db3e44e1263 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:25.599309 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3bcaa68e-83ea-4e14-bb1a-8db3e44e1263 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:25.600286 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3bcaa68e-83ea-4e14-bb1a-8db3e44e1263 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:25.604056 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3bcaa68e-83ea-4e14-bb1a-8db3e44e1263 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:26.381792 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3bcaa68e-83ea-4e14-bb1a-8db3e44e1263 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:26.393904 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3bcaa68e-83ea-4e14-bb1a-8db3e44e1263 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1548 microversion: 2.1 time: 0.823203 Feb 28 10:34:26.408270 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 191/369] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:25 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1548 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:26.420508 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a6dc6ec8-be5a-468a-bb69-595fd54a7900 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:26.426366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a6dc6ec8-be5a-468a-bb69-595fd54a7900 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:26.462420 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ec8-be5a-468a-bb69-595fd54a7900 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:26.464739 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ec8-be5a-468a-bb69-595fd54a7900 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:26.467902 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ec8-be5a-468a-bb69-595fd54a7900 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:26.471122 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a6dc6ec8-be5a-468a-bb69-595fd54a7900 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:26.517837 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] validate_networks() for None {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:34:26.770951 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-a6dc6ec8-be5a-468a-bb69-595fd54a7900 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] HTTP exception thrown: Cannot 'detach_volume' instance e1560b32-2ab2-4234-aeca-5cbe2d745915 while it is in vm_state rescued Feb 28 10:34:26.771669 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a6dc6ec8-be5a-468a-bb69-595fd54a7900 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Returning 409 to user: Cannot 'detach_volume' instance e1560b32-2ab2-4234-aeca-5cbe2d745915 while it is in vm_state rescued {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:34:26.772693 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a6dc6ec8-be5a-468a-bb69-595fd54a7900 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments/9aeeb9e4-b914-4a2e-a36e-4a5eaa6cd2b8" status: 409 len: 152 microversion: 2.1 time: 0.363028 Feb 28 10:34:26.776626 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 192/370] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:34:26 2022] DELETE /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments/9aeeb9e4-b914-4a2e-a36e-4a5eaa6cd2b8 => generated 152 bytes in 365 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 28 10:34:26.781793 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:26.785506 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:26.816116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:26.816948 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:26.818002 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:26.818897 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:27.354682 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:34:27.355983 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:34:27.359052 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:34:27.359597 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:34:27.360037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:34:27.373066 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:27.373606 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:27.374458 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:27.374955 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:27.395510 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Getting quotas for project 5064c06558bb43eead0db5aa0ce93841. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:34:27.400221 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Getting quotas for user d8f75162c65b4e96a113adb0e1b2d11d and project 5064c06558bb43eead0db5aa0ce93841. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:34:27.416457 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:34:27.418999 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:34:27.475831 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-573b9045-32c0-4142-a466-29a09454cdeb tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.535777 Feb 28 10:34:27.481097 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 179/371] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 28 10:34:27.486235 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8c529c6f-25a1-4fc7-a940-10800926e754 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:27.487338 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8c529c6f-25a1-4fc7-a940-10800926e754 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:27.494139 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c529c6f-25a1-4fc7-a940-10800926e754 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:27.494876 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c529c6f-25a1-4fc7-a940-10800926e754 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:27.497472 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c529c6f-25a1-4fc7-a940-10800926e754 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:27.497926 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c529c6f-25a1-4fc7-a940-10800926e754 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:27.597977 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:27.613827 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:27.617218 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:27.619905 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1bebbf1d-510c-4010-aaa0-dd2b96fef504 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1739 microversion: 2.20 time: 0.844521 Feb 28 10:34:27.630658 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 193/372] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:26 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1739 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:27.631066 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8c529c6f-25a1-4fc7-a940-10800926e754 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/action" status: 202 len: 0 microversion: 2.1 time: 0.136811 Feb 28 10:34:27.631516 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-aa9e6456-0db3-4081-b75e-b25c41868712 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:27.631516 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-aa9e6456-0db3-4081-b75e-b25c41868712 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:27.632076 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 180/373] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:34:27 2022] POST /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:34:27.655036 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3e809823-ec9e-45ba-8ce4-d8034cd1016d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:27.655766 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3e809823-ec9e-45ba-8ce4-d8034cd1016d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:27.662524 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3e809823-ec9e-45ba-8ce4-d8034cd1016d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:27.663015 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3e809823-ec9e-45ba-8ce4-d8034cd1016d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:27.664650 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3e809823-ec9e-45ba-8ce4-d8034cd1016d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:27.665357 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3e809823-ec9e-45ba-8ce4-d8034cd1016d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:27.721950 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-aa9e6456-0db3-4081-b75e-b25c41868712 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:27.731331 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-aa9e6456-0db3-4081-b75e-b25c41868712 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1215 microversion: 2.1 time: 0.106551 Feb 28 10:34:27.732720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 194/374] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:27 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:28.282225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3e809823-ec9e-45ba-8ce4-d8034cd1016d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:28.294217 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3e809823-ec9e-45ba-8ce4-d8034cd1016d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1556 microversion: 2.1 time: 0.651439 Feb 28 10:34:28.295163 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 181/375] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:27 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1556 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:28.652390 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:28.652390 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:28.654919 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:28.655543 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:28.657123 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:28.657657 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:28.750639 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e2449138-7071-4abc-8225-45598fec26ae tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:28.752300 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e2449138-7071-4abc-8225-45598fec26ae tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:28.760550 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e2449138-7071-4abc-8225-45598fec26ae tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:28.761018 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e2449138-7071-4abc-8225-45598fec26ae tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:28.761828 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e2449138-7071-4abc-8225-45598fec26ae tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:28.763270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e2449138-7071-4abc-8225-45598fec26ae tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:29.140990 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e2449138-7071-4abc-8225-45598fec26ae tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:29.153432 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e2449138-7071-4abc-8225-45598fec26ae tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1267 microversion: 2.1 time: 0.406195 Feb 28 10:34:29.155863 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 182/376] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:28 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1267 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:29.313513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-53943d7d-32db-4d43-b437-cb71cd70298c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:29.314526 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-53943d7d-32db-4d43-b437-cb71cd70298c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:29.328441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-53943d7d-32db-4d43-b437-cb71cd70298c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:29.329175 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-53943d7d-32db-4d43-b437-cb71cd70298c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:29.330222 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-53943d7d-32db-4d43-b437-cb71cd70298c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:29.330719 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-53943d7d-32db-4d43-b437-cb71cd70298c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:29.462532 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:29.472476 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:29.474379 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:29.475798 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f21bc7f3-7320-4973-a5b6-8eb0ddd49b89 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1721 microversion: 2.20 time: 0.838651 Feb 28 10:34:29.487254 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 195/377] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:28 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1721 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:29.640172 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-53943d7d-32db-4d43-b437-cb71cd70298c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:29.681608 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-53943d7d-32db-4d43-b437-cb71cd70298c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1556 microversion: 2.1 time: 0.373114 Feb 28 10:34:29.692797 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 183/378] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:29 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1556 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:30.172904 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-03fc613c-ddfd-4c0c-9a44-caf1e67a84d7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:30.173638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-03fc613c-ddfd-4c0c-9a44-caf1e67a84d7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:30.183103 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-68e5845a-9a15-4881-bf1b-14fdaeee4d11 req-720aea05-c0ef-4fb2-bfa6-68e1fc9e0e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ead279e-e2e9-4312-a47a-fbec064ce99b", "name": "network-vif-unplugged", "status": "completed", "tag": "76aed61f-8cd7-4455-a163-d78d7f320a35"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:30.196962 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-03fc613c-ddfd-4c0c-9a44-caf1e67a84d7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:30.199173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-03fc613c-ddfd-4c0c-9a44-caf1e67a84d7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:30.200387 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-03fc613c-ddfd-4c0c-9a44-caf1e67a84d7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:30.200923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-68e5845a-9a15-4881-bf1b-14fdaeee4d11 req-720aea05-c0ef-4fb2-bfa6-68e1fc9e0e7b service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:30.201536 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-68e5845a-9a15-4881-bf1b-14fdaeee4d11 req-720aea05-c0ef-4fb2-bfa6-68e1fc9e0e7b service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:30.202149 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-03fc613c-ddfd-4c0c-9a44-caf1e67a84d7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:30.235710 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-68e5845a-9a15-4881-bf1b-14fdaeee4d11 req-720aea05-c0ef-4fb2-bfa6-68e1fc9e0e7b service nova] Creating event network-vif-unplugged:76aed61f-8cd7-4455-a163-d78d7f320a35 for instance 1ead279e-e2e9-4312-a47a-fbec064ce99b on hv-cinder-maste Feb 28 10:34:30.261760 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-68e5845a-9a15-4881-bf1b-14fdaeee4d11 req-720aea05-c0ef-4fb2-bfa6-68e1fc9e0e7b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083228 Feb 28 10:34:30.262770 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 184/379] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:34:30.323998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-03fc613c-ddfd-4c0c-9a44-caf1e67a84d7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:30.332378 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-03fc613c-ddfd-4c0c-9a44-caf1e67a84d7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1273 microversion: 2.1 time: 0.164408 Feb 28 10:34:30.344188 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 196/380] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:30 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:30.495294 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:30.496002 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:30.513603 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:30.514062 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:30.514908 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:30.517326 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:30.711155 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1a696524-293d-488d-9499-48d709a2b292 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:30.712041 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1a696524-293d-488d-9499-48d709a2b292 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:30.736767 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1a696524-293d-488d-9499-48d709a2b292 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:30.737469 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1a696524-293d-488d-9499-48d709a2b292 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:30.738457 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1a696524-293d-488d-9499-48d709a2b292 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:30.739118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1a696524-293d-488d-9499-48d709a2b292 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:30.811449 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:30.824792 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:30.826380 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:30.827669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3e7911d1-4de4-40db-82a5-e60220ea3866 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1721 microversion: 2.20 time: 0.336891 Feb 28 10:34:30.851199 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 185/381] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:30 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1721 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:30.946695 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1a696524-293d-488d-9499-48d709a2b292 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:30.955283 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1a696524-293d-488d-9499-48d709a2b292 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1556 microversion: 2.1 time: 0.249855 Feb 28 10:34:30.956967 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 197/382] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:30 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1556 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:31.350851 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7d71b1f0-f454-48b4-91a4-81f927211c5b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:31.351484 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7d71b1f0-f454-48b4-91a4-81f927211c5b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:31.366241 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7d71b1f0-f454-48b4-91a4-81f927211c5b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:31.366803 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7d71b1f0-f454-48b4-91a4-81f927211c5b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:31.370849 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7d71b1f0-f454-48b4-91a4-81f927211c5b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:31.371382 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7d71b1f0-f454-48b4-91a4-81f927211c5b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:31.800289 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-a7e533a6-edc6-46bd-a3a7-4477b2a81033 req-11a22968-db9a-46cf-b9a4-d8c60bc40480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a106010-a1a1-4a6b-85b0-7788c63b00b3", "tag": "21d2234b-c39e-4863-b298-1fbac7193271"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:31.801407 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7d71b1f0-f454-48b4-91a4-81f927211c5b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:31.816970 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7d71b1f0-f454-48b4-91a4-81f927211c5b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1315 microversion: 2.1 time: 0.469422 Feb 28 10:34:31.822341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-a7e533a6-edc6-46bd-a3a7-4477b2a81033 req-11a22968-db9a-46cf-b9a4-d8c60bc40480 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:31.826421 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-a7e533a6-edc6-46bd-a3a7-4477b2a81033 req-11a22968-db9a-46cf-b9a4-d8c60bc40480 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:31.830353 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 186/383] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:31 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:31.858418 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:31.859465 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:31.864827 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-a7e533a6-edc6-46bd-a3a7-4477b2a81033 req-11a22968-db9a-46cf-b9a4-d8c60bc40480 service nova] Creating event network-changed:21d2234b-c39e-4863-b298-1fbac7193271 for instance 2a106010-a1a1-4a6b-85b0-7788c63b00b3 on hv-cinder-maste Feb 28 10:34:31.867428 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:31.868081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:31.869230 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:31.870002 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:31.884009 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-a7e533a6-edc6-46bd-a3a7-4477b2a81033 req-11a22968-db9a-46cf-b9a4-d8c60bc40480 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087478 Feb 28 10:34:31.884611 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 198/384] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:34:31.980567 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6c816056-43d2-45b6-a7d0-e89264e11cac tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:31.981636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6c816056-43d2-45b6-a7d0-e89264e11cac tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:31.998802 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6c816056-43d2-45b6-a7d0-e89264e11cac tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:31.999289 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6c816056-43d2-45b6-a7d0-e89264e11cac tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:32.000141 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6c816056-43d2-45b6-a7d0-e89264e11cac tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:32.000561 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6c816056-43d2-45b6-a7d0-e89264e11cac tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:32.508752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:32.539287 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:32.541147 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:32.545052 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-46dd7011-88f8-4386-a0e9-450942972314 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1724 microversion: 2.20 time: 0.693890 Feb 28 10:34:32.564285 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 187/385] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:31 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1724 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:32.572491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6c816056-43d2-45b6-a7d0-e89264e11cac tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:32.591842 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3de36a75-402f-4d77-8515-9d63a228b4bb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dfbbc83-56bf-4476-b780-043edefe4ceb"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:32.593192 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3de36a75-402f-4d77-8515-9d63a228b4bb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:32.594278 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6c816056-43d2-45b6-a7d0-e89264e11cac tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1562 microversion: 2.1 time: 0.622539 Feb 28 10:34:32.597460 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 199/386] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:31 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1562 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:32.628088 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3de36a75-402f-4d77-8515-9d63a228b4bb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:32.638513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3de36a75-402f-4d77-8515-9d63a228b4bb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:32.641665 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3de36a75-402f-4d77-8515-9d63a228b4bb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:32.649862 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3de36a75-402f-4d77-8515-9d63a228b4bb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:32.785707 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-276a3ae9-012b-45c2-bf10-bbecbd5d2762 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:32.788882 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-276a3ae9-012b-45c2-bf10-bbecbd5d2762 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:32.796412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-276a3ae9-012b-45c2-bf10-bbecbd5d2762 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:32.797133 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-276a3ae9-012b-45c2-bf10-bbecbd5d2762 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:32.798306 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-276a3ae9-012b-45c2-bf10-bbecbd5d2762 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:32.799053 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-276a3ae9-012b-45c2-bf10-bbecbd5d2762 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:33.020557 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-276a3ae9-012b-45c2-bf10-bbecbd5d2762 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lazy-loading 'services' on Instance uuid e1560b32-2ab2-4234-aeca-5cbe2d745915 {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:34:33.408849 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-276a3ae9-012b-45c2-bf10-bbecbd5d2762 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments/9aeeb9e4-b914-4a2e-a36e-4a5eaa6cd2b8" status: 202 len: 0 microversion: 2.1 time: 0.623062 Feb 28 10:34:33.415876 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 200/387] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:34:32 2022] DELETE /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments/9aeeb9e4-b914-4a2e-a36e-4a5eaa6cd2b8 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:34:33.429038 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-bf6f8e71-fed0-49b8-b389-f845f4f54dcd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:33.430851 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-bf6f8e71-fed0-49b8-b389-f845f4f54dcd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:33.440524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bf6f8e71-fed0-49b8-b389-f845f4f54dcd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:33.441186 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bf6f8e71-fed0-49b8-b389-f845f4f54dcd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:33.442208 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bf6f8e71-fed0-49b8-b389-f845f4f54dcd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:33.443028 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bf6f8e71-fed0-49b8-b389-f845f4f54dcd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:33.725298 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3de36a75-402f-4d77-8515-9d63a228b4bb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.152712 Feb 28 10:34:33.729487 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 188/388] 10.222.0.21 () {62 vars in 1363 bytes} [Mon Feb 28 10:34:32 2022] POST /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments => generated 188 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:34:33.752959 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9c039847-a5e8-4c4d-bc50-f1e1d072b05c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:33.757121 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9c039847-a5e8-4c4d-bc50-f1e1d072b05c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:33.802269 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9c039847-a5e8-4c4d-bc50-f1e1d072b05c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:33.804922 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9c039847-a5e8-4c4d-bc50-f1e1d072b05c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:33.805808 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9c039847-a5e8-4c4d-bc50-f1e1d072b05c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:33.806269 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9c039847-a5e8-4c4d-bc50-f1e1d072b05c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:33.831834 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-bf6f8e71-fed0-49b8-b389-f845f4f54dcd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:33.840458 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-bf6f8e71-fed0-49b8-b389-f845f4f54dcd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1315 microversion: 2.1 time: 0.423103 Feb 28 10:34:33.845415 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 201/389] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:33 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:33.887969 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9c039847-a5e8-4c4d-bc50-f1e1d072b05c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156610 Feb 28 10:34:33.888898 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 189/390] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:34:33 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:34:33.933845 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f07be9b2-0f4a-4f8d-a157-a707c6a2aceb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:33.936637 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f07be9b2-0f4a-4f8d-a157-a707c6a2aceb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:33.943061 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f07be9b2-0f4a-4f8d-a157-a707c6a2aceb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:33.943835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f07be9b2-0f4a-4f8d-a157-a707c6a2aceb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:33.944884 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f07be9b2-0f4a-4f8d-a157-a707c6a2aceb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:33.945558 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f07be9b2-0f4a-4f8d-a157-a707c6a2aceb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:34.125344 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f07be9b2-0f4a-4f8d-a157-a707c6a2aceb tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/action" status: 202 len: 0 microversion: 2.20 time: 0.201595 Feb 28 10:34:34.125953 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 202/391] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Feb 28 10:34:33 2022] POST /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:34:34.135678 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:34.136304 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:34.152077 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:34.152544 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:34.153941 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:34.154390 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:34.479037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:34.490800 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:34.492577 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:34.501776 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5430b59f-0c21-44c7-813a-57ec99ca3f3c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1750 microversion: 2.20 time: 0.370037 Feb 28 10:34:34.503028 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 190/392] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:34 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1750 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:34.865297 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-fdc5ab65-9bd9-48cb-8d1f-76f8fd16e233 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:34.866217 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-fdc5ab65-9bd9-48cb-8d1f-76f8fd16e233 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:34.874183 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fdc5ab65-9bd9-48cb-8d1f-76f8fd16e233 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:34.874906 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fdc5ab65-9bd9-48cb-8d1f-76f8fd16e233 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:34.875975 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fdc5ab65-9bd9-48cb-8d1f-76f8fd16e233 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:34.876549 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fdc5ab65-9bd9-48cb-8d1f-76f8fd16e233 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:34.900488 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-516aff4e-42b1-47c0-b452-566759a5d275 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:34.904813 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-516aff4e-42b1-47c0-b452-566759a5d275 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:34.914187 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-516aff4e-42b1-47c0-b452-566759a5d275 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:34.915125 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-516aff4e-42b1-47c0-b452-566759a5d275 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:34.916293 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-516aff4e-42b1-47c0-b452-566759a5d275 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:34.916900 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-516aff4e-42b1-47c0-b452-566759a5d275 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:34.959950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-516aff4e-42b1-47c0-b452-566759a5d275 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063516 Feb 28 10:34:34.964585 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 191/393] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:34:34 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:34:35.094497 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-fdc5ab65-9bd9-48cb-8d1f-76f8fd16e233 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:35.104005 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-fdc5ab65-9bd9-48cb-8d1f-76f8fd16e233 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1315 microversion: 2.1 time: 0.247082 Feb 28 10:34:35.117415 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 203/394] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:34 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:35.520557 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:35.521466 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:35.530924 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:35.531383 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:35.532186 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:35.532625 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:35.705366 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:35.714456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:35.716903 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:35.718733 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-934d247b-833e-4cc1-bd06-1878b95861ea tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1750 microversion: 2.20 time: 0.201666 Feb 28 10:34:35.724081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 192/395] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:35 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1750 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:35.971993 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d0d02aef-be98-4a2b-a3e9-b609167c8868 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:35.973736 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d0d02aef-be98-4a2b-a3e9-b609167c8868 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:35.983496 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0d02aef-be98-4a2b-a3e9-b609167c8868 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:35.984353 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0d02aef-be98-4a2b-a3e9-b609167c8868 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:35.985241 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0d02aef-be98-4a2b-a3e9-b609167c8868 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:35.985828 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0d02aef-be98-4a2b-a3e9-b609167c8868 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:36.027538 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d0d02aef-be98-4a2b-a3e9-b609167c8868 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059409 Feb 28 10:34:36.030930 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 204/396] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:34:35 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:34:36.124928 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5710ead8-b09b-47eb-840b-217230ea5236 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:36.126095 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5710ead8-b09b-47eb-840b-217230ea5236 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:36.134145 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5710ead8-b09b-47eb-840b-217230ea5236 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:36.134833 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5710ead8-b09b-47eb-840b-217230ea5236 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:36.135906 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5710ead8-b09b-47eb-840b-217230ea5236 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:36.136677 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5710ead8-b09b-47eb-840b-217230ea5236 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:36.327701 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5710ead8-b09b-47eb-840b-217230ea5236 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:36.347260 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5710ead8-b09b-47eb-840b-217230ea5236 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1315 microversion: 2.1 time: 0.226449 Feb 28 10:34:36.348570 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 193/397] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:36 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:36.736619 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:36.737226 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:36.743567 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:36.744222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:36.745176 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:36.745776 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:36.904724 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:36.914906 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:36.916387 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:36.917749 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a690fcde-f36f-4430-b1d2-e3ba7bfe42a2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1750 microversion: 2.20 time: 0.184985 Feb 28 10:34:36.918863 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 205/398] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:36 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:37.041221 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-758de25e-0f47-4692-a1dd-3c7ef97a76f1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:37.042491 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-758de25e-0f47-4692-a1dd-3c7ef97a76f1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:37.055805 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-758de25e-0f47-4692-a1dd-3c7ef97a76f1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:37.056264 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-758de25e-0f47-4692-a1dd-3c7ef97a76f1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:37.057122 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-758de25e-0f47-4692-a1dd-3c7ef97a76f1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:37.058047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-758de25e-0f47-4692-a1dd-3c7ef97a76f1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:37.094999 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-758de25e-0f47-4692-a1dd-3c7ef97a76f1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058825 Feb 28 10:34:37.099219 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 194/399] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:34:37 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:34:37.365209 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1612e2c1-b4e0-4443-9208-e84ca0ac0824 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:37.365848 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1612e2c1-b4e0-4443-9208-e84ca0ac0824 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:37.372776 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1612e2c1-b4e0-4443-9208-e84ca0ac0824 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:37.373222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1612e2c1-b4e0-4443-9208-e84ca0ac0824 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:37.374010 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1612e2c1-b4e0-4443-9208-e84ca0ac0824 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:37.374444 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1612e2c1-b4e0-4443-9208-e84ca0ac0824 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:37.549063 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1612e2c1-b4e0-4443-9208-e84ca0ac0824 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:37.557768 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1612e2c1-b4e0-4443-9208-e84ca0ac0824 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1315 microversion: 2.1 time: 0.196372 Feb 28 10:34:37.558481 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 206/400] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:37 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:37.938443 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:37.941027 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:37.947799 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:37.948249 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:37.949178 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:37.950445 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:38.108893 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:38.109678 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6566f2f7-59e5-4f0b-801b-ab37b300d8b0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:38.110926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6566f2f7-59e5-4f0b-801b-ab37b300d8b0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:38.118188 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6566f2f7-59e5-4f0b-801b-ab37b300d8b0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:38.119178 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6566f2f7-59e5-4f0b-801b-ab37b300d8b0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:38.122149 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:38.123869 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6566f2f7-59e5-4f0b-801b-ab37b300d8b0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:38.124621 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6566f2f7-59e5-4f0b-801b-ab37b300d8b0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:38.128379 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:38.129569 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b742777b-cfc1-44fa-8bef-7338c6886b4c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1752 microversion: 2.20 time: 0.196696 Feb 28 10:34:38.131350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 195/401] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:37 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1752 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:38.161118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6566f2f7-59e5-4f0b-801b-ab37b300d8b0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056955 Feb 28 10:34:38.162367 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 207/402] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:34:38 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 10:34:38.575586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-191496c5-8671-49da-a557-399fc48c964b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:38.576116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-191496c5-8671-49da-a557-399fc48c964b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:38.584688 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-191496c5-8671-49da-a557-399fc48c964b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:38.585399 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-191496c5-8671-49da-a557-399fc48c964b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:38.586369 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-191496c5-8671-49da-a557-399fc48c964b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:38.586860 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-191496c5-8671-49da-a557-399fc48c964b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:38.747424 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-191496c5-8671-49da-a557-399fc48c964b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:38.758899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-191496c5-8671-49da-a557-399fc48c964b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1315 microversion: 2.1 time: 0.187816 Feb 28 10:34:38.764800 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 196/403] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:38 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:39.148693 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:39.149973 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:39.158549 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:39.159366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:39.160173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:39.160604 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:39.350008 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:39.364240 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:39.366958 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:39.368589 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8f0aa8a1-c9cc-4784-8517-cb8e54d19733 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1752 microversion: 2.20 time: 0.223877 Feb 28 10:34:39.369953 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 208/404] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:39 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:39.779562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0f98a5bf-4a2d-422a-95e6-87859e8ecedd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:39.781035 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0f98a5bf-4a2d-422a-95e6-87859e8ecedd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:39.788176 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0f98a5bf-4a2d-422a-95e6-87859e8ecedd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:39.788630 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0f98a5bf-4a2d-422a-95e6-87859e8ecedd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:39.789467 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0f98a5bf-4a2d-422a-95e6-87859e8ecedd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:39.789910 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0f98a5bf-4a2d-422a-95e6-87859e8ecedd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:39.992781 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0f98a5bf-4a2d-422a-95e6-87859e8ecedd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:40.003597 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0f98a5bf-4a2d-422a-95e6-87859e8ecedd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1315 microversion: 2.1 time: 0.228534 Feb 28 10:34:40.004432 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 197/405] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:39 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:40.306651 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-54919c73-648e-40f0-87a7-2ab481c77038 req-9f1b2218-b5f7-4af5-b52c-bc8812740d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a106010-a1a1-4a6b-85b0-7788c63b00b3", "name": "network-vif-plugged", "status": "completed", "tag": "21d2234b-c39e-4863-b298-1fbac7193271"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:40.342910 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-54919c73-648e-40f0-87a7-2ab481c77038 req-9f1b2218-b5f7-4af5-b52c-bc8812740d31 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:40.343863 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-54919c73-648e-40f0-87a7-2ab481c77038 req-9f1b2218-b5f7-4af5-b52c-bc8812740d31 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:40.375550 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-54919c73-648e-40f0-87a7-2ab481c77038 req-9f1b2218-b5f7-4af5-b52c-bc8812740d31 service nova] Creating event network-vif-plugged:21d2234b-c39e-4863-b298-1fbac7193271 for instance 2a106010-a1a1-4a6b-85b0-7788c63b00b3 on hv-cinder-maste Feb 28 10:34:40.386222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-54919c73-648e-40f0-87a7-2ab481c77038 req-9f1b2218-b5f7-4af5-b52c-bc8812740d31 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082973 Feb 28 10:34:40.388037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 209/406] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:34:40.388845 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:40.389512 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:40.401220 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:40.403313 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:40.404723 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:40.408286 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:40.631458 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:40.638209 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0d53ae55-b51b-4c8d-9aa7-e836424924bb tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:40.638861 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0d53ae55-b51b-4c8d-9aa7-e836424924bb tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:40.647473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:40.647735 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0d53ae55-b51b-4c8d-9aa7-e836424924bb tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:40.647981 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0d53ae55-b51b-4c8d-9aa7-e836424924bb tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:40.648789 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0d53ae55-b51b-4c8d-9aa7-e836424924bb tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:40.649219 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0d53ae55-b51b-4c8d-9aa7-e836424924bb tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:40.651047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:40.666225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-fbd19a62-3dac-4bb8-b0da-d5609a2336cd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.270338 Feb 28 10:34:40.670727 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 198/407] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:40 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:40.717253 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0d53ae55-b51b-4c8d-9aa7-e836424924bb tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:34:40.882316 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0d53ae55-b51b-4c8d-9aa7-e836424924bb tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 204 len: 0 microversion: 2.1 time: 0.250611 Feb 28 10:34:40.883268 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 210/408] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:34:40 2022] DELETE /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 10:34:40.891890 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-80872f21-f3aa-43a5-9a92-26dfeb196137 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:40.892602 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-80872f21-f3aa-43a5-9a92-26dfeb196137 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:40.903110 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-80872f21-f3aa-43a5-9a92-26dfeb196137 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:40.903573 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-80872f21-f3aa-43a5-9a92-26dfeb196137 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:40.904587 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-80872f21-f3aa-43a5-9a92-26dfeb196137 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:40.904989 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-80872f21-f3aa-43a5-9a92-26dfeb196137 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:41.024673 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9c6354eb-0462-411c-a099-b5ceb1dab768 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:41.025603 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9c6354eb-0462-411c-a099-b5ceb1dab768 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:41.033697 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c6354eb-0462-411c-a099-b5ceb1dab768 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:41.034370 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c6354eb-0462-411c-a099-b5ceb1dab768 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:41.035227 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c6354eb-0462-411c-a099-b5ceb1dab768 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:41.035644 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c6354eb-0462-411c-a099-b5ceb1dab768 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:41.070940 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-80872f21-f3aa-43a5-9a92-26dfeb196137 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:41.083348 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-80872f21-f3aa-43a5-9a92-26dfeb196137 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.196159 Feb 28 10:34:41.086979 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 199/409] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:40 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:41.196769 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9c6354eb-0462-411c-a099-b5ceb1dab768 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:41.205910 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9c6354eb-0462-411c-a099-b5ceb1dab768 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1315 microversion: 2.1 time: 0.187046 Feb 28 10:34:41.206484 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 211/410] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:41 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:41.687857 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:41.688921 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:41.695053 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:41.698392 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:41.699930 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:41.700563 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:41.856407 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:41.868863 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:41.871142 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:41.873359 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-437c1a56-c76b-4012-999c-41ffc207d66d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.189838 Feb 28 10:34:41.874479 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 200/411] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:41 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:42.102235 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b6648e25-c5c6-4f75-a4e0-83d4ed18170a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:42.102885 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b6648e25-c5c6-4f75-a4e0-83d4ed18170a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:42.119510 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b6648e25-c5c6-4f75-a4e0-83d4ed18170a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:42.120237 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b6648e25-c5c6-4f75-a4e0-83d4ed18170a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:42.121154 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b6648e25-c5c6-4f75-a4e0-83d4ed18170a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:42.123051 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b6648e25-c5c6-4f75-a4e0-83d4ed18170a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:42.252066 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-165410b8-a695-457d-8a6a-ac8d43298314 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:42.253907 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-165410b8-a695-457d-8a6a-ac8d43298314 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:42.263383 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-165410b8-a695-457d-8a6a-ac8d43298314 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:42.264152 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-165410b8-a695-457d-8a6a-ac8d43298314 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:42.266746 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-165410b8-a695-457d-8a6a-ac8d43298314 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:42.267332 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-165410b8-a695-457d-8a6a-ac8d43298314 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:42.494345 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b6648e25-c5c6-4f75-a4e0-83d4ed18170a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:42.509571 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b6648e25-c5c6-4f75-a4e0-83d4ed18170a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.411887 Feb 28 10:34:42.512670 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 212/412] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:42 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:42.584764 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-165410b8-a695-457d-8a6a-ac8d43298314 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:42.593003 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-165410b8-a695-457d-8a6a-ac8d43298314 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1315 microversion: 2.1 time: 0.372323 Feb 28 10:34:42.603332 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 201/413] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:42 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:42.892422 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:42.893062 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:42.899529 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:42.899971 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:42.900773 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:42.901204 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:43.016682 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1868345567", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1600317973", "security_groups": [{"name": "tempest-secgroup-smoke-341917082"}], "networks": [{"uuid": "956c294a-5b07-4205-ad8a-387d3422fbe8"}], "block_device_mapping_v2": [{"uuid": "c4173f52-3202-4cf4-8a0b-e37bb5334ce6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:43.128791 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:43.146789 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:43.148549 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:43.149930 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8f81db12-1904-49b0-9f5e-4affedad8476 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.261682 Feb 28 10:34:43.162848 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 213/414] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:42 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:43.238235 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] validate_networks() for [('956c294a-5b07-4205-ad8a-387d3422fbe8', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:34:43.530255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f2ad62a4-640a-4006-99fa-2f9f62af0335 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:43.530904 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f2ad62a4-640a-4006-99fa-2f9f62af0335 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:43.540979 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f2ad62a4-640a-4006-99fa-2f9f62af0335 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:43.549570 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f2ad62a4-640a-4006-99fa-2f9f62af0335 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:43.550710 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f2ad62a4-640a-4006-99fa-2f9f62af0335 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:43.551016 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f2ad62a4-640a-4006-99fa-2f9f62af0335 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:43.952797 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f2ad62a4-640a-4006-99fa-2f9f62af0335 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:43.961163 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f2ad62a4-640a-4006-99fa-2f9f62af0335 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.435243 Feb 28 10:34:43.964872 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 214/415] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:43 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:43.975616 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-41b39b9e-feab-42b3-9685-c6d3e8a03d00 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:43.976446 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-41b39b9e-feab-42b3-9685-c6d3e8a03d00 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:43.999284 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-41b39b9e-feab-42b3-9685-c6d3e8a03d00 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:44.008681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-41b39b9e-feab-42b3-9685-c6d3e8a03d00 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:44.011559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-41b39b9e-feab-42b3-9685-c6d3e8a03d00 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:44.011559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-41b39b9e-feab-42b3-9685-c6d3e8a03d00 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:44.208018 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:34:44.209043 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:34:44.209674 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:34:44.210262 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:34:44.210899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:34:44.227865 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:44.229477 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:44.230546 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:44.232256 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:44.281745 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-41b39b9e-feab-42b3-9685-c6d3e8a03d00 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:44.290825 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-41b39b9e-feab-42b3-9685-c6d3e8a03d00 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1464 microversion: 2.1 time: 0.323169 Feb 28 10:34:44.294098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 215/416] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:43 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:44.296142 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Getting quotas for project b55c46d5c05b41adb823461813ee1e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:34:44.305033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9923d1dd-ec8d-4e61-82c8-e8071ed9c948 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Action: 'create', calling method: .version_select at 0x7f1c58544ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-377015774"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:44.306545 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Getting quotas for user 5b21c9002601480eaabdbcb74d337f2a and project b55c46d5c05b41adb823461813ee1e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:34:44.344137 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-9923d1dd-ec8d-4e61-82c8-e8071ed9c948 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Getting quotas for project b8784f6a53624f7688d9ae0ae0e15169. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:34:44.349111 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-9923d1dd-ec8d-4e61-82c8-e8071ed9c948 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Getting quotas for user e840e28ad3194d7ea995ea2d2b57843e and project b8784f6a53624f7688d9ae0ae0e15169. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:34:44.439862 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:34:44.442800 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4173f52-3202-4cf4-8a0b-e37bb5334ce6',volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:34:44.595645 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-9923d1dd-ec8d-4e61-82c8-e8071ed9c948 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Getting quotas for project b8784f6a53624f7688d9ae0ae0e15169. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:34:44.601431 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-9923d1dd-ec8d-4e61-82c8-e8071ed9c948 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Getting quotas for user e840e28ad3194d7ea995ea2d2b57843e and project b8784f6a53624f7688d9ae0ae0e15169. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:34:44.615386 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9923d1dd-ec8d-4e61-82c8-e8071ed9c948 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.318359 Feb 28 10:34:44.616355 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 216/417] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 10:34:44 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:44.620920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:44.622761 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:44.640303 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9b30c84e-943b-4eb5-a027-65a537a5e701 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.628704 Feb 28 10:34:44.644655 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 202/418] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:34:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:34:44.655983 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:44.656543 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:44.658408 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:44.659659 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:44.661361 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-46a8f29d-546a-426d-8fff-3ddf8e50e75c tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:44.666558 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-46a8f29d-546a-426d-8fff-3ddf8e50e75c tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:44.693758 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-46a8f29d-546a-426d-8fff-3ddf8e50e75c tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:44.694930 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-46a8f29d-546a-426d-8fff-3ddf8e50e75c tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:44.697740 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-46a8f29d-546a-426d-8fff-3ddf8e50e75c tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:44.699726 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-46a8f29d-546a-426d-8fff-3ddf8e50e75c tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:44.754871 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-46a8f29d-546a-426d-8fff-3ddf8e50e75c tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Going to try to terminate instance {{(pid=123151) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:34:44.880801 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:44.900998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:44.907452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:44.911170 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-060fef05-5ff3-49d2-a99a-b5ce1820a75d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.292204 Feb 28 10:34:44.933006 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 217/419] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:44 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:44.939298 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9c1f7fb3-9f0e-4417-8966-4c4c22aaecdc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:44.940090 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9c1f7fb3-9f0e-4417-8966-4c4c22aaecdc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:44.959310 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-46a8f29d-546a-426d-8fff-3ddf8e50e75c tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 204 len: 0 microversion: 2.1 time: 0.312706 Feb 28 10:34:44.960861 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 203/420] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:34:44 2022] DELETE /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:34:44.967459 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-904411423", "imageRef": "5ee1fefa-7562-431d-a940-923aa044c499", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-377015774", "networks": [{"uuid": "08ce50bb-e12e-4613-b944-9efdb4ba7ded"}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:45.037235 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9c1f7fb3-9f0e-4417-8966-4c4c22aaecdc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:45.050988 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9c1f7fb3-9f0e-4417-8966-4c4c22aaecdc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1089 microversion: 2.1 time: 0.112945 Feb 28 10:34:45.052894 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 218/421] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:44 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1089 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:45.058333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3c424caa-b3ed-4f51-88e9-c35a84594f91 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:45.059725 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3c424caa-b3ed-4f51-88e9-c35a84594f91 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:45.066314 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3c424caa-b3ed-4f51-88e9-c35a84594f91 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:45.066918 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3c424caa-b3ed-4f51-88e9-c35a84594f91 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:45.067776 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3c424caa-b3ed-4f51-88e9-c35a84594f91 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:45.068335 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3c424caa-b3ed-4f51-88e9-c35a84594f91 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:45.580099 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3c424caa-b3ed-4f51-88e9-c35a84594f91 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:45.589581 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3c424caa-b3ed-4f51-88e9-c35a84594f91 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.534975 Feb 28 10:34:45.590294 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 219/422] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:45 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:45.604387 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ec394729-11f9-4357-9abb-884b87b8b04c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:45.605144 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ec394729-11f9-4357-9abb-884b87b8b04c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:45.611843 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ec394729-11f9-4357-9abb-884b87b8b04c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:45.612288 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ec394729-11f9-4357-9abb-884b87b8b04c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:45.613084 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ec394729-11f9-4357-9abb-884b87b8b04c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:45.613523 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ec394729-11f9-4357-9abb-884b87b8b04c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:45.752583 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ec394729-11f9-4357-9abb-884b87b8b04c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:45.760722 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ec394729-11f9-4357-9abb-884b87b8b04c tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.167249 Feb 28 10:34:45.761457 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 220/423] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:45 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:45.932529 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:45.933389 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:45.941548 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:45.941928 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:45.942771 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:45.943216 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:46.114204 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:46.124100 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:46.125602 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:46.126855 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-698441d9-26a8-42f7-8dd6-0eef71b7954c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.198878 Feb 28 10:34:46.127420 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 221/424] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:45 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:46.134478 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8560b28f-3cff-4515-8d85-e9ff70a88d25 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:46.135114 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8560b28f-3cff-4515-8d85-e9ff70a88d25 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:46.142099 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8560b28f-3cff-4515-8d85-e9ff70a88d25 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:46.142582 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8560b28f-3cff-4515-8d85-e9ff70a88d25 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:46.143377 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8560b28f-3cff-4515-8d85-e9ff70a88d25 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:46.143813 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8560b28f-3cff-4515-8d85-e9ff70a88d25 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:46.206935 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8560b28f-3cff-4515-8d85-e9ff70a88d25 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:46.214618 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8560b28f-3cff-4515-8d85-e9ff70a88d25 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1139 microversion: 2.1 time: 0.085885 Feb 28 10:34:46.215253 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 222/425] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:46 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:46.608458 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-77442677-f0d6-4a41-91be-2c682f05e3d2 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:46.609184 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-77442677-f0d6-4a41-91be-2c682f05e3d2 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:46.618328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-77442677-f0d6-4a41-91be-2c682f05e3d2 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:46.618834 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-77442677-f0d6-4a41-91be-2c682f05e3d2 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:46.619694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-77442677-f0d6-4a41-91be-2c682f05e3d2 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:46.620333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-77442677-f0d6-4a41-91be-2c682f05e3d2 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:46.768375 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-77442677-f0d6-4a41-91be-2c682f05e3d2 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:46.775989 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-77442677-f0d6-4a41-91be-2c682f05e3d2 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.171980 Feb 28 10:34:46.776810 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 223/426] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:46 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:46.783907 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-942e444d-d128-47a8-8a38-cf725142196d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:46.784743 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-942e444d-d128-47a8-8a38-cf725142196d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:46.792021 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-942e444d-d128-47a8-8a38-cf725142196d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:46.792606 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-942e444d-d128-47a8-8a38-cf725142196d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:46.794116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-942e444d-d128-47a8-8a38-cf725142196d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:46.794890 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-942e444d-d128-47a8-8a38-cf725142196d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:46.952472 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-942e444d-d128-47a8-8a38-cf725142196d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:46.962096 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-942e444d-d128-47a8-8a38-cf725142196d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.182183 Feb 28 10:34:46.966756 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 224/427] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:46 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:47.148383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:47.149348 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:47.159825 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:47.160699 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:47.161729 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:47.162260 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:47.330638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:47.339695 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:47.342036 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:47.343134 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-47a7e184-f167-4ebc-8f0e-7001691c4083 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.199606 Feb 28 10:34:47.343706 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 225/428] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:47 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:47.348517 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c0621155-301b-4b3f-9b18-620348cdea76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:47.349151 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c0621155-301b-4b3f-9b18-620348cdea76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:47.356752 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c0621155-301b-4b3f-9b18-620348cdea76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:47.357293 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c0621155-301b-4b3f-9b18-620348cdea76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:47.358102 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c0621155-301b-4b3f-9b18-620348cdea76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:47.358562 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c0621155-301b-4b3f-9b18-620348cdea76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:47.419363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c0621155-301b-4b3f-9b18-620348cdea76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:47.430194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c0621155-301b-4b3f-9b18-620348cdea76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1139 microversion: 2.1 time: 0.085426 Feb 28 10:34:47.431098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 226/429] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:47 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:47.795360 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b72adfe2-64bc-448d-8366-9b9de6960b59 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:47.796303 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b72adfe2-64bc-448d-8366-9b9de6960b59 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:47.802816 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b72adfe2-64bc-448d-8366-9b9de6960b59 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:47.803368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b72adfe2-64bc-448d-8366-9b9de6960b59 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:47.804249 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b72adfe2-64bc-448d-8366-9b9de6960b59 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:47.804768 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b72adfe2-64bc-448d-8366-9b9de6960b59 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:47.956440 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b72adfe2-64bc-448d-8366-9b9de6960b59 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:47.965920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b72adfe2-64bc-448d-8366-9b9de6960b59 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.174899 Feb 28 10:34:47.966778 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 227/430] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:47 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:47.980380 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5bba17c2-9206-4d1c-953e-85cb1e2464be tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:47.982545 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5bba17c2-9206-4d1c-953e-85cb1e2464be tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:47.987328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5bba17c2-9206-4d1c-953e-85cb1e2464be tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:47.987782 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5bba17c2-9206-4d1c-953e-85cb1e2464be tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:47.988577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5bba17c2-9206-4d1c-953e-85cb1e2464be tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:47.989015 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5bba17c2-9206-4d1c-953e-85cb1e2464be tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:48.135442 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5bba17c2-9206-4d1c-953e-85cb1e2464be tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:48.142337 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5bba17c2-9206-4d1c-953e-85cb1e2464be tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.166049 Feb 28 10:34:48.142962 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 228/431] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:47 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:48.364620 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:48.365531 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:48.372837 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:48.373306 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:48.374160 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:48.374681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:48.534466 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:48.542788 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:48.545181 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:48.546329 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-636c04a5-d000-4c20-bbf2-adc363d475b8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.186651 Feb 28 10:34:48.554758 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 229/432] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:48 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:48.554758 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6bd97fbd-7c8e-493c-8ad6-288afb596d40 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:48.554758 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6bd97fbd-7c8e-493c-8ad6-288afb596d40 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:48.560273 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6bd97fbd-7c8e-493c-8ad6-288afb596d40 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:48.560726 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6bd97fbd-7c8e-493c-8ad6-288afb596d40 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:48.561524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6bd97fbd-7c8e-493c-8ad6-288afb596d40 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:48.561954 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6bd97fbd-7c8e-493c-8ad6-288afb596d40 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:48.650104 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6bd97fbd-7c8e-493c-8ad6-288afb596d40 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:48.661389 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6bd97fbd-7c8e-493c-8ad6-288afb596d40 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1139 microversion: 2.1 time: 0.113408 Feb 28 10:34:48.661984 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 230/433] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:48 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1139 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:48.984301 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a973408d-c675-44d2-be11-c80646d96a68 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:48.985011 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a973408d-c675-44d2-be11-c80646d96a68 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:48.990900 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a973408d-c675-44d2-be11-c80646d96a68 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:48.991357 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a973408d-c675-44d2-be11-c80646d96a68 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:48.992891 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a973408d-c675-44d2-be11-c80646d96a68 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:48.993341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a973408d-c675-44d2-be11-c80646d96a68 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:49.139255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a973408d-c675-44d2-be11-c80646d96a68 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:49.153559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a973408d-c675-44d2-be11-c80646d96a68 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.173536 Feb 28 10:34:49.154158 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 231/434] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:48 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:49.165081 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-35281ae9-621d-4b05-95b9-7b79b9cf601f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:49.165711 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-35281ae9-621d-4b05-95b9-7b79b9cf601f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:49.172636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-35281ae9-621d-4b05-95b9-7b79b9cf601f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:49.173093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-35281ae9-621d-4b05-95b9-7b79b9cf601f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:49.173892 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-35281ae9-621d-4b05-95b9-7b79b9cf601f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:49.174330 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-35281ae9-621d-4b05-95b9-7b79b9cf601f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:49.323346 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-35281ae9-621d-4b05-95b9-7b79b9cf601f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:49.330871 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-35281ae9-621d-4b05-95b9-7b79b9cf601f tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.170305 Feb 28 10:34:49.331443 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 232/435] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:49 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:49.565068 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:49.565686 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:49.572981 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:49.573740 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:49.574917 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:49.577405 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:49.746155 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:49.756240 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:49.757994 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:49.759577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-74f553ab-bd32-4fdc-a058-d214f5a8b6ca tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.198467 Feb 28 10:34:49.766659 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 233/436] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:49 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:49.766659 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e1967f0a-747c-4d3b-93d1-5049e29b2cf4 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:49.767004 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e1967f0a-747c-4d3b-93d1-5049e29b2cf4 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:49.773178 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e1967f0a-747c-4d3b-93d1-5049e29b2cf4 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:49.773714 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e1967f0a-747c-4d3b-93d1-5049e29b2cf4 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:49.774571 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e1967f0a-747c-4d3b-93d1-5049e29b2cf4 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:49.775098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e1967f0a-747c-4d3b-93d1-5049e29b2cf4 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:49.848973 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e1967f0a-747c-4d3b-93d1-5049e29b2cf4 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:49.857149 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e1967f0a-747c-4d3b-93d1-5049e29b2cf4 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1139 microversion: 2.1 time: 0.095815 Feb 28 10:34:49.857717 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 234/437] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:49 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1139 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:50.175153 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3512d55f-b2b3-423d-b0fa-9a9c5ef8241b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:50.176724 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3512d55f-b2b3-423d-b0fa-9a9c5ef8241b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:50.183244 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3512d55f-b2b3-423d-b0fa-9a9c5ef8241b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:50.183731 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3512d55f-b2b3-423d-b0fa-9a9c5ef8241b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:50.184736 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3512d55f-b2b3-423d-b0fa-9a9c5ef8241b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:50.185094 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3512d55f-b2b3-423d-b0fa-9a9c5ef8241b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:50.344852 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3512d55f-b2b3-423d-b0fa-9a9c5ef8241b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:50.352373 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3512d55f-b2b3-423d-b0fa-9a9c5ef8241b tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.182067 Feb 28 10:34:50.362809 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 235/438] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:50 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:50.362809 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-257aec25-20a4-4eca-9517-dcc4803758c1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:50.362809 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-257aec25-20a4-4eca-9517-dcc4803758c1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:50.367997 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-257aec25-20a4-4eca-9517-dcc4803758c1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:50.368463 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-257aec25-20a4-4eca-9517-dcc4803758c1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:50.369281 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-257aec25-20a4-4eca-9517-dcc4803758c1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:50.369752 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-257aec25-20a4-4eca-9517-dcc4803758c1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:50.517604 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-257aec25-20a4-4eca-9517-dcc4803758c1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:50.524943 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-257aec25-20a4-4eca-9517-dcc4803758c1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.171059 Feb 28 10:34:50.525507 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 236/439] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:50 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:50.781497 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:50.782108 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:50.790048 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:50.790514 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:50.791366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:50.791808 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:50.957471 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:50.970271 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:50.971971 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:50.973161 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1426b552-6c94-4a8d-bd51-7e0e144a3c39 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.197099 Feb 28 10:34:50.976220 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 237/440] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:50 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:50.979899 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1fad7e44-7459-423d-862f-344bc5a9f104 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:50.980583 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1fad7e44-7459-423d-862f-344bc5a9f104 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:50.988868 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1fad7e44-7459-423d-862f-344bc5a9f104 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:50.989325 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1fad7e44-7459-423d-862f-344bc5a9f104 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:50.990122 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1fad7e44-7459-423d-862f-344bc5a9f104 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:50.990562 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1fad7e44-7459-423d-862f-344bc5a9f104 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:51.054160 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1fad7e44-7459-423d-862f-344bc5a9f104 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:51.062367 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1fad7e44-7459-423d-862f-344bc5a9f104 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1139 microversion: 2.1 time: 0.087161 Feb 28 10:34:51.062994 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 238/441] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:50 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:51.372200 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-85a4195f-95fa-4da2-88d4-1d868b1c444f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:51.373032 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-85a4195f-95fa-4da2-88d4-1d868b1c444f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:51.378844 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-85a4195f-95fa-4da2-88d4-1d868b1c444f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:51.379345 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-85a4195f-95fa-4da2-88d4-1d868b1c444f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:51.380234 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-85a4195f-95fa-4da2-88d4-1d868b1c444f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:51.380572 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-85a4195f-95fa-4da2-88d4-1d868b1c444f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:51.498190 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] validate_networks() for [('08ce50bb-e12e-4613-b944-9efdb4ba7ded', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:34:51.544933 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-85a4195f-95fa-4da2-88d4-1d868b1c444f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:51.552484 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-85a4195f-95fa-4da2-88d4-1d868b1c444f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.184759 Feb 28 10:34:51.553321 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 239/442] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:51 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:51.557594 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f991d455-5c29-40d3-99f2-bc2a70218736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:51.558277 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f991d455-5c29-40d3-99f2-bc2a70218736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:51.564481 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f991d455-5c29-40d3-99f2-bc2a70218736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:51.564934 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f991d455-5c29-40d3-99f2-bc2a70218736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:51.565722 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f991d455-5c29-40d3-99f2-bc2a70218736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:51.566157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f991d455-5c29-40d3-99f2-bc2a70218736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:51.772612 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f991d455-5c29-40d3-99f2-bc2a70218736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:51.785171 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f991d455-5c29-40d3-99f2-bc2a70218736 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.227650 Feb 28 10:34:51.785171 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 240/443] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:51 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:51.979260 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:34:51.979680 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:34:51.980178 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:34:51.980579 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:34:51.981911 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:34:51.991153 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:51.991604 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:51.992420 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:51.992542 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:51.992859 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:51.993047 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:52.001008 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:52.001622 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:52.002719 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:52.003194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:52.011118 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Getting quotas for project b8784f6a53624f7688d9ae0ae0e15169. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:34:52.015668 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Getting quotas for user e840e28ad3194d7ea995ea2d2b57843e and project b8784f6a53624f7688d9ae0ae0e15169. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:34:52.028791 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:34:52.030912 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ee1fefa-7562-431d-a940-923aa044c499',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:34:52.084288 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-052ec603-56d2-49c9-9245-fc85f641f6da tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.121999 Feb 28 10:34:52.085222 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 204/444] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:34:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 7124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:34:52.091180 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5ffc7cae-8436-4e3d-94e2-5b119a239cc6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:52.092039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5ffc7cae-8436-4e3d-94e2-5b119a239cc6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:52.098929 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ffc7cae-8436-4e3d-94e2-5b119a239cc6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:52.099659 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ffc7cae-8436-4e3d-94e2-5b119a239cc6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:52.100665 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ffc7cae-8436-4e3d-94e2-5b119a239cc6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:52.101303 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ffc7cae-8436-4e3d-94e2-5b119a239cc6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:52.182158 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5ffc7cae-8436-4e3d-94e2-5b119a239cc6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:52.194977 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5ffc7cae-8436-4e3d-94e2-5b119a239cc6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1131 microversion: 2.1 time: 0.108367 Feb 28 10:34:52.195872 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 205/445] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:52 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1131 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:52.201297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-790e0ffa-b989-4390-9222-4124bed5f0c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:52.202216 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-790e0ffa-b989-4390-9222-4124bed5f0c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:52.209569 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:52.219926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:52.221606 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:52.222918 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ea3214c5-5d6c-4ff6-ba7f-5af8640c018d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.235264 Feb 28 10:34:52.226654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 241/446] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:51 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:52.262741 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-790e0ffa-b989-4390-9222-4124bed5f0c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:52.269462 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-790e0ffa-b989-4390-9222-4124bed5f0c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1257 microversion: 2.1 time: 0.072486 Feb 28 10:34:52.270027 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 206/447] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:52 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:52.570730 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-45c1e4b7-9698-400e-902d-4092e94e3d9a tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:52.571455 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-45c1e4b7-9698-400e-902d-4092e94e3d9a tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:52.578682 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-45c1e4b7-9698-400e-902d-4092e94e3d9a tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:52.579137 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-45c1e4b7-9698-400e-902d-4092e94e3d9a tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:52.579936 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-45c1e4b7-9698-400e-902d-4092e94e3d9a tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:52.580375 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-45c1e4b7-9698-400e-902d-4092e94e3d9a tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:52.722501 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-45c1e4b7-9698-400e-902d-4092e94e3d9a tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:52.729962 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-45c1e4b7-9698-400e-902d-4092e94e3d9a tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.164175 Feb 28 10:34:52.730528 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 242/448] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:52 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:52.799582 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-447b32e1-03e4-4b87-9885-57b52322cd88 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:52.800725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-447b32e1-03e4-4b87-9885-57b52322cd88 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:52.806736 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-447b32e1-03e4-4b87-9885-57b52322cd88 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:52.807194 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-447b32e1-03e4-4b87-9885-57b52322cd88 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:52.808014 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-447b32e1-03e4-4b87-9885-57b52322cd88 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:52.808455 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-447b32e1-03e4-4b87-9885-57b52322cd88 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:52.972994 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-447b32e1-03e4-4b87-9885-57b52322cd88 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:52.990012 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-447b32e1-03e4-4b87-9885-57b52322cd88 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.194217 Feb 28 10:34:52.990957 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 207/449] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:52 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:53.212298 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-97e42bec-1c97-4cab-90de-8a836c43ad57 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:53.213088 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-97e42bec-1c97-4cab-90de-8a836c43ad57 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:53.220504 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-97e42bec-1c97-4cab-90de-8a836c43ad57 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:53.221068 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-97e42bec-1c97-4cab-90de-8a836c43ad57 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:53.221928 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-97e42bec-1c97-4cab-90de-8a836c43ad57 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:53.222459 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-97e42bec-1c97-4cab-90de-8a836c43ad57 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:53.241519 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:53.242416 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:53.248736 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:53.249239 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:53.250010 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:53.250494 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:53.305300 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-97e42bec-1c97-4cab-90de-8a836c43ad57 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:53.316532 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-97e42bec-1c97-4cab-90de-8a836c43ad57 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1205 microversion: 2.1 time: 0.108043 Feb 28 10:34:53.326755 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 243/450] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:53 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1205 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:53.331921 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7463e642-ec9e-4e19-99f2-c190b1c5f506 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:53.332721 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7463e642-ec9e-4e19-99f2-c190b1c5f506 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:53.342038 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7463e642-ec9e-4e19-99f2-c190b1c5f506 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:53.342490 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7463e642-ec9e-4e19-99f2-c190b1c5f506 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:53.345433 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7463e642-ec9e-4e19-99f2-c190b1c5f506 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:53.345952 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7463e642-ec9e-4e19-99f2-c190b1c5f506 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:53.432474 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7463e642-ec9e-4e19-99f2-c190b1c5f506 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:53.440244 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:53.441823 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7463e642-ec9e-4e19-99f2-c190b1c5f506 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1309 microversion: 2.1 time: 0.113739 Feb 28 10:34:53.443735 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 244/451] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:53 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:53.468063 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:53.469827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:53.471035 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-297bcbd9-2f70-49ce-b474-4f247880bc81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.233408 Feb 28 10:34:53.471952 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 208/452] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:53 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:34:53.747299 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9c7b5e9e-5682-4831-834a-5ccedf113f66 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:53.748677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9c7b5e9e-5682-4831-834a-5ccedf113f66 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:53.756132 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c7b5e9e-5682-4831-834a-5ccedf113f66 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:53.757574 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c7b5e9e-5682-4831-834a-5ccedf113f66 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:53.759006 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c7b5e9e-5682-4831-834a-5ccedf113f66 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:53.759661 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c7b5e9e-5682-4831-834a-5ccedf113f66 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:54.008995 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-71fabf27-57d7-4737-a4b5-ef870a949485 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:54.010426 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-71fabf27-57d7-4737-a4b5-ef870a949485 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:54.022189 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71fabf27-57d7-4737-a4b5-ef870a949485 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:54.024169 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71fabf27-57d7-4737-a4b5-ef870a949485 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:54.026421 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71fabf27-57d7-4737-a4b5-ef870a949485 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:54.028080 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71fabf27-57d7-4737-a4b5-ef870a949485 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:54.174110 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9c7b5e9e-5682-4831-834a-5ccedf113f66 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:54.188596 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9c7b5e9e-5682-4831-834a-5ccedf113f66 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.441838 Feb 28 10:34:54.189947 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 245/453] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:53 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:54.333901 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3ea50f2d-afab-4a39-b0f5-fb8a89abf43c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:54.334780 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3ea50f2d-afab-4a39-b0f5-fb8a89abf43c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:54.346697 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3ea50f2d-afab-4a39-b0f5-fb8a89abf43c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:54.349483 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3ea50f2d-afab-4a39-b0f5-fb8a89abf43c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:54.354359 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3ea50f2d-afab-4a39-b0f5-fb8a89abf43c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:54.355090 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3ea50f2d-afab-4a39-b0f5-fb8a89abf43c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:54.516284 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-71fabf27-57d7-4737-a4b5-ef870a949485 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:54.562660 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-71fabf27-57d7-4737-a4b5-ef870a949485 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.549851 Feb 28 10:34:54.570050 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 209/454] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:54 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:54.570050 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-da252ddc-ac6b-44b0-9f70-d23325141652 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:54.570050 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-da252ddc-ac6b-44b0-9f70-d23325141652 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:54.587511 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-da252ddc-ac6b-44b0-9f70-d23325141652 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:54.588470 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-da252ddc-ac6b-44b0-9f70-d23325141652 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:54.592055 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-da252ddc-ac6b-44b0-9f70-d23325141652 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:54.592513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-da252ddc-ac6b-44b0-9f70-d23325141652 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:54.805266 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-da252ddc-ac6b-44b0-9f70-d23325141652 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:54.818707 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-da252ddc-ac6b-44b0-9f70-d23325141652 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1315 microversion: 2.1 time: 0.253672 Feb 28 10:34:54.819411 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 210/455] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:54 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:54.840904 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:54.841486 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:54.859474 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:54.859980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:54.861513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:54.861513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:54.876794 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3ea50f2d-afab-4a39-b0f5-fb8a89abf43c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:54.885456 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3ea50f2d-afab-4a39-b0f5-fb8a89abf43c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.555597 Feb 28 10:34:54.888431 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 246/456] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:54 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:55.214280 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9d508829-de41-4e03-9f7f-9e654f27482f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:55.215441 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9d508829-de41-4e03-9f7f-9e654f27482f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:55.236744 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9d508829-de41-4e03-9f7f-9e654f27482f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:55.239180 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9d508829-de41-4e03-9f7f-9e654f27482f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:55.241133 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9d508829-de41-4e03-9f7f-9e654f27482f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:55.241919 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9d508829-de41-4e03-9f7f-9e654f27482f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:55.260690 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:55.272124 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:55.280806 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:55.284704 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-860b25b8-5e34-4250-91d6-f37391970c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.454414 Feb 28 10:34:55.285447 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 211/457] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:54 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:55.502204 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-18f9ba1b-1c6b-4203-bd78-a1b429ad47b0 req-dc34eba2-0651-4bea-a4da-4c0e676455be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6a8a33-e76e-450b-a94a-a0852fc6472c", "tag": "c294705d-35da-4f5d-8e43-0a930f3b63a3"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:55.519501 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-18f9ba1b-1c6b-4203-bd78-a1b429ad47b0 req-dc34eba2-0651-4bea-a4da-4c0e676455be service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:55.519974 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-18f9ba1b-1c6b-4203-bd78-a1b429ad47b0 req-dc34eba2-0651-4bea-a4da-4c0e676455be service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:55.572214 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9d508829-de41-4e03-9f7f-9e654f27482f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:55.581557 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9d508829-de41-4e03-9f7f-9e654f27482f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.378505 Feb 28 10:34:55.582968 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-18f9ba1b-1c6b-4203-bd78-a1b429ad47b0 req-dc34eba2-0651-4bea-a4da-4c0e676455be service nova] Creating event network-changed:c294705d-35da-4f5d-8e43-0a930f3b63a3 for instance 6f6a8a33-e76e-450b-a94a-a0852fc6472c on hv-cinder-maste Feb 28 10:34:55.592450 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 247/458] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:55 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:55.597737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-bec2887e-9821-455b-9acd-3231b5b0cef0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:55.598584 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-18f9ba1b-1c6b-4203-bd78-a1b429ad47b0 req-dc34eba2-0651-4bea-a4da-4c0e676455be service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105945 Feb 28 10:34:55.599220 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 212/459] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:34:55.599576 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-bec2887e-9821-455b-9acd-3231b5b0cef0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:55.615951 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bec2887e-9821-455b-9acd-3231b5b0cef0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:55.616694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bec2887e-9821-455b-9acd-3231b5b0cef0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:55.617679 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bec2887e-9821-455b-9acd-3231b5b0cef0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:55.628684 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bec2887e-9821-455b-9acd-3231b5b0cef0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:55.836939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f4579094-04ac-43b9-9194-78b7346430a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:55.837617 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f4579094-04ac-43b9-9194-78b7346430a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:55.864192 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f4579094-04ac-43b9-9194-78b7346430a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:55.865189 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f4579094-04ac-43b9-9194-78b7346430a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:55.866245 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f4579094-04ac-43b9-9194-78b7346430a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:55.868411 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f4579094-04ac-43b9-9194-78b7346430a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:55.869620 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-bec2887e-9821-455b-9acd-3231b5b0cef0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:55.878917 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-bec2887e-9821-455b-9acd-3231b5b0cef0 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.285061 Feb 28 10:34:55.880503 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 248/460] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:55 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:55.909042 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6ff201c4-39e0-4c22-8d4f-0714cc3ffeac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:55.909967 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6ff201c4-39e0-4c22-8d4f-0714cc3ffeac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:55.938701 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6ff201c4-39e0-4c22-8d4f-0714cc3ffeac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:55.939560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6ff201c4-39e0-4c22-8d4f-0714cc3ffeac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:55.940612 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6ff201c4-39e0-4c22-8d4f-0714cc3ffeac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:55.941272 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6ff201c4-39e0-4c22-8d4f-0714cc3ffeac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:56.167726 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f4579094-04ac-43b9-9194-78b7346430a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:56.176444 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f4579094-04ac-43b9-9194-78b7346430a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.343751 Feb 28 10:34:56.186631 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 213/461] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:55 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:56.193639 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6ff201c4-39e0-4c22-8d4f-0714cc3ffeac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:56.201585 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6ff201c4-39e0-4c22-8d4f-0714cc3ffeac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.299222 Feb 28 10:34:56.202250 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 249/462] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:55 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:34:56.304855 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:56.305604 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:56.314793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:56.315270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:56.316089 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:56.316527 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:56.482794 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:56.491278 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:56.492780 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:56.493942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ff15d4d8-9884-42d3-b7be-e229c062cb5a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.193002 Feb 28 10:34:56.494500 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 214/463] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:56 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:56.598769 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-bba768b4-0752-4509-90bd-4aeb64442b3f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:56.599377 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-bba768b4-0752-4509-90bd-4aeb64442b3f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:56.605629 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bba768b4-0752-4509-90bd-4aeb64442b3f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:56.607409 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bba768b4-0752-4509-90bd-4aeb64442b3f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:56.608202 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bba768b4-0752-4509-90bd-4aeb64442b3f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:56.608636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bba768b4-0752-4509-90bd-4aeb64442b3f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:56.753542 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-bba768b4-0752-4509-90bd-4aeb64442b3f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:56.760726 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-bba768b4-0752-4509-90bd-4aeb64442b3f tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.165758 Feb 28 10:34:56.761297 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 250/464] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:56 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:56.896387 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0839118c-c936-42a3-80b5-1402bad1f71d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:56.896996 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0839118c-c936-42a3-80b5-1402bad1f71d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:56.905750 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0839118c-c936-42a3-80b5-1402bad1f71d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:56.906915 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0839118c-c936-42a3-80b5-1402bad1f71d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:56.907951 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0839118c-c936-42a3-80b5-1402bad1f71d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:56.908391 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0839118c-c936-42a3-80b5-1402bad1f71d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:57.054793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0839118c-c936-42a3-80b5-1402bad1f71d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:57.062917 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0839118c-c936-42a3-80b5-1402bad1f71d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.170434 Feb 28 10:34:57.063499 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 215/465] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:56 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:57.193612 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b0269df2-2307-4651-ba26-d5104ef3b32c tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:57.194381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b0269df2-2307-4651-ba26-d5104ef3b32c tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:57.201388 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b0269df2-2307-4651-ba26-d5104ef3b32c tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:57.201927 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b0269df2-2307-4651-ba26-d5104ef3b32c tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:57.202826 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b0269df2-2307-4651-ba26-d5104ef3b32c tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:57.203338 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b0269df2-2307-4651-ba26-d5104ef3b32c tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:57.218679 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f697a12f-7069-42d0-9739-4e6911b9aa70 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:57.219294 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f697a12f-7069-42d0-9739-4e6911b9aa70 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:57.227280 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f697a12f-7069-42d0-9739-4e6911b9aa70 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:57.227723 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f697a12f-7069-42d0-9739-4e6911b9aa70 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:57.228548 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f697a12f-7069-42d0-9739-4e6911b9aa70 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:57.228976 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f697a12f-7069-42d0-9739-4e6911b9aa70 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:57.428932 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b0269df2-2307-4651-ba26-d5104ef3b32c tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:57.434440 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f697a12f-7069-42d0-9739-4e6911b9aa70 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:57.443367 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b0269df2-2307-4651-ba26-d5104ef3b32c tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.253518 Feb 28 10:34:57.453201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 251/466] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:57 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:57.457964 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f697a12f-7069-42d0-9739-4e6911b9aa70 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.243180 Feb 28 10:34:57.458732 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 216/467] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:57 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:57.512997 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:57.513626 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:57.519875 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:57.520328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:57.521105 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:57.521541 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:57.666059 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:57.674640 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:57.676519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:57.677968 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e2736a47-34f3-4ada-93ac-c8d55f393182 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.169122 Feb 28 10:34:57.678824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 252/468] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:57 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:57.779270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-edaab159-9523-4589-a415-8be494be3acf tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:57.779891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-edaab159-9523-4589-a415-8be494be3acf tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:57.790294 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-edaab159-9523-4589-a415-8be494be3acf tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:57.790773 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-edaab159-9523-4589-a415-8be494be3acf tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:57.791567 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-edaab159-9523-4589-a415-8be494be3acf tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:57.792003 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-edaab159-9523-4589-a415-8be494be3acf tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:57.938816 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-edaab159-9523-4589-a415-8be494be3acf tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:57.946235 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-edaab159-9523-4589-a415-8be494be3acf tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.172170 Feb 28 10:34:57.947038 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 217/469] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:57 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:58.080937 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7d96ec0d-bcd1-41c4-91aa-521c9106ec62 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:58.081546 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7d96ec0d-bcd1-41c4-91aa-521c9106ec62 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:58.088606 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7d96ec0d-bcd1-41c4-91aa-521c9106ec62 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.089706 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7d96ec0d-bcd1-41c4-91aa-521c9106ec62 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.091034 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7d96ec0d-bcd1-41c4-91aa-521c9106ec62 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.091836 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7d96ec0d-bcd1-41c4-91aa-521c9106ec62 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.253632 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7d96ec0d-bcd1-41c4-91aa-521c9106ec62 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:58.263355 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7d96ec0d-bcd1-41c4-91aa-521c9106ec62 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.186216 Feb 28 10:34:58.264349 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 253/470] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:58 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:58.358872 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-f293aeea-3cab-4434-b293-0d85d2f6297e req-f1a1a548-1144-43e3-ba4c-510d425e5bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a106010-a1a1-4a6b-85b0-7788c63b00b3", "name": "network-vif-unplugged", "status": "completed", "tag": "21d2234b-c39e-4863-b298-1fbac7193271"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:34:58.367699 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-f293aeea-3cab-4434-b293-0d85d2f6297e req-f1a1a548-1144-43e3-ba4c-510d425e5bf7 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.368200 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-f293aeea-3cab-4434-b293-0d85d2f6297e req-f1a1a548-1144-43e3-ba4c-510d425e5bf7 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.381440 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-f293aeea-3cab-4434-b293-0d85d2f6297e req-f1a1a548-1144-43e3-ba4c-510d425e5bf7 service nova] Creating event network-vif-unplugged:21d2234b-c39e-4863-b298-1fbac7193271 for instance 2a106010-a1a1-4a6b-85b0-7788c63b00b3 on hv-cinder-maste Feb 28 10:34:58.386405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-f293aeea-3cab-4434-b293-0d85d2f6297e req-f1a1a548-1144-43e3-ba4c-510d425e5bf7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031327 Feb 28 10:34:58.387918 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 218/471] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:34:58.460585 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f07cd77c-5106-4929-8a87-0f20b6619ea6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:58.461331 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f07cd77c-5106-4929-8a87-0f20b6619ea6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:58.468650 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f07cd77c-5106-4929-8a87-0f20b6619ea6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.470446 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f07cd77c-5106-4929-8a87-0f20b6619ea6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.470446 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f07cd77c-5106-4929-8a87-0f20b6619ea6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.470678 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f07cd77c-5106-4929-8a87-0f20b6619ea6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.476107 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-66cb79c7-b215-403c-832a-84178d815252 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:58.476820 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-66cb79c7-b215-403c-832a-84178d815252 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:58.486215 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-66cb79c7-b215-403c-832a-84178d815252 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.486743 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-66cb79c7-b215-403c-832a-84178d815252 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.487563 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-66cb79c7-b215-403c-832a-84178d815252 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.487998 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-66cb79c7-b215-403c-832a-84178d815252 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.681914 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f07cd77c-5106-4929-8a87-0f20b6619ea6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:58.691865 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f07cd77c-5106-4929-8a87-0f20b6619ea6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.235099 Feb 28 10:34:58.692781 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 254/472] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:58 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:58.698902 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:58.700033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:58.702328 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-66cb79c7-b215-403c-832a-84178d815252 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:58.706993 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.707474 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.708284 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.708720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.713435 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-66cb79c7-b215-403c-832a-84178d815252 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.241431 Feb 28 10:34:58.714283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 219/473] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:58 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:58.867029 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:58.875839 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:58.877343 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:58.878540 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-92ce56bd-b1ee-43ca-8ee4-683a1e2fbf0e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.184299 Feb 28 10:34:58.879295 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 255/474] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:58 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:34:58.964525 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b41941c6-5bd5-4d08-9f08-8d1ecc8b39c9 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:58.965736 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b41941c6-5bd5-4d08-9f08-8d1ecc8b39c9 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:58.973127 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b41941c6-5bd5-4d08-9f08-8d1ecc8b39c9 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.973573 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b41941c6-5bd5-4d08-9f08-8d1ecc8b39c9 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:58.974357 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b41941c6-5bd5-4d08-9f08-8d1ecc8b39c9 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:58.974818 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b41941c6-5bd5-4d08-9f08-8d1ecc8b39c9 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:59.119808 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b41941c6-5bd5-4d08-9f08-8d1ecc8b39c9 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:59.128152 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b41941c6-5bd5-4d08-9f08-8d1ecc8b39c9 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.168437 Feb 28 10:34:59.129172 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 220/475] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:58 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:59.279772 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-62be4b8e-9fad-48ce-afe3-2122eb538fa8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:59.280583 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-62be4b8e-9fad-48ce-afe3-2122eb538fa8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:59.287854 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62be4b8e-9fad-48ce-afe3-2122eb538fa8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:59.288490 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62be4b8e-9fad-48ce-afe3-2122eb538fa8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:59.289455 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62be4b8e-9fad-48ce-afe3-2122eb538fa8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:59.289993 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62be4b8e-9fad-48ce-afe3-2122eb538fa8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:59.446277 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-62be4b8e-9fad-48ce-afe3-2122eb538fa8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:59.459810 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-62be4b8e-9fad-48ce-afe3-2122eb538fa8 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.183938 Feb 28 10:34:59.460563 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 256/476] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:59 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:59.709183 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-67f36598-dfa1-4c6e-93df-87c72e9d4580 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:59.709784 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-67f36598-dfa1-4c6e-93df-87c72e9d4580 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:59.716891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-67f36598-dfa1-4c6e-93df-87c72e9d4580 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:59.718476 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-67f36598-dfa1-4c6e-93df-87c72e9d4580 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:59.719319 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-67f36598-dfa1-4c6e-93df-87c72e9d4580 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:59.719739 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-67f36598-dfa1-4c6e-93df-87c72e9d4580 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:59.733705 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-57259666-f70b-4b98-91e0-ae684f27ecb6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:59.734771 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-57259666-f70b-4b98-91e0-ae684f27ecb6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:59.741474 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-57259666-f70b-4b98-91e0-ae684f27ecb6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:59.742149 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-57259666-f70b-4b98-91e0-ae684f27ecb6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:59.743051 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-57259666-f70b-4b98-91e0-ae684f27ecb6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:59.743558 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-57259666-f70b-4b98-91e0-ae684f27ecb6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:59.934378 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-67f36598-dfa1-4c6e-93df-87c72e9d4580 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:59.942711 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-67f36598-dfa1-4c6e-93df-87c72e9d4580 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.237153 Feb 28 10:34:59.953248 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 221/477] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:59 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:34:59.958299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:34:59.958945 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:34:59.965547 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:59.966005 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:59.966850 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:34:59.967292 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:34:59.968031 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-57259666-f70b-4b98-91e0-ae684f27ecb6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:34:59.978526 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-57259666-f70b-4b98-91e0-ae684f27ecb6 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.248722 Feb 28 10:34:59.986365 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 257/478] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:34:59 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:00.115997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:00.125901 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:00.126726 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:00.127937 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-1f612e77-6204-46e0-abcb-05ed68fab240 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.173528 Feb 28 10:35:00.128503 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 222/479] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:34:59 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:35:00.146900 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-91072ff7-1599-4025-9aad-48325407008d tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:00.147599 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-91072ff7-1599-4025-9aad-48325407008d tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:00.153931 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-91072ff7-1599-4025-9aad-48325407008d tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:00.154385 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-91072ff7-1599-4025-9aad-48325407008d tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:00.155279 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-91072ff7-1599-4025-9aad-48325407008d tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:00.155647 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-91072ff7-1599-4025-9aad-48325407008d tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:00.296940 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-91072ff7-1599-4025-9aad-48325407008d tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:00.304358 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-91072ff7-1599-4025-9aad-48325407008d tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.162143 Feb 28 10:35:00.305110 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 258/480] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:00 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:00.478264 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a003bc70-e9d4-416e-ac55-b26944cfea85 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:00.478897 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a003bc70-e9d4-416e-ac55-b26944cfea85 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:00.485493 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a003bc70-e9d4-416e-ac55-b26944cfea85 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:00.485939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a003bc70-e9d4-416e-ac55-b26944cfea85 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:00.486743 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a003bc70-e9d4-416e-ac55-b26944cfea85 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:00.487172 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a003bc70-e9d4-416e-ac55-b26944cfea85 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:00.624276 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a003bc70-e9d4-416e-ac55-b26944cfea85 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:00.632752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a003bc70-e9d4-416e-ac55-b26944cfea85 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.159210 Feb 28 10:35:00.633326 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 223/481] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:00 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:00.962259 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ff8762e4-4b00-48f7-aa59-c993f94a05fd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:00.963598 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ff8762e4-4b00-48f7-aa59-c993f94a05fd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:00.979487 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ff8762e4-4b00-48f7-aa59-c993f94a05fd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:00.979487 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ff8762e4-4b00-48f7-aa59-c993f94a05fd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:00.979487 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ff8762e4-4b00-48f7-aa59-c993f94a05fd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:00.979487 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ff8762e4-4b00-48f7-aa59-c993f94a05fd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:01.008776 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f7fe5d10-6c7a-4957-bbb2-cc47e079a8db tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:01.011191 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f7fe5d10-6c7a-4957-bbb2-cc47e079a8db tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:01.056974 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f7fe5d10-6c7a-4957-bbb2-cc47e079a8db tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:01.056974 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f7fe5d10-6c7a-4957-bbb2-cc47e079a8db tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:01.057311 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f7fe5d10-6c7a-4957-bbb2-cc47e079a8db tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:01.057772 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f7fe5d10-6c7a-4957-bbb2-cc47e079a8db tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:01.237711 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ff8762e4-4b00-48f7-aa59-c993f94a05fd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:01.247620 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ff8762e4-4b00-48f7-aa59-c993f94a05fd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.290235 Feb 28 10:35:01.259481 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 259/482] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:00 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:01.265131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:01.265834 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:01.272334 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:01.272893 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:01.273701 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:01.274143 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:01.279406 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f7fe5d10-6c7a-4957-bbb2-cc47e079a8db tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:01.286820 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f7fe5d10-6c7a-4957-bbb2-cc47e079a8db tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.295188 Feb 28 10:35:01.287680 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 224/483] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:00 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:01.321372 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c3fab94f-78f6-4a53-b000-41f63509d8dd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:01.322106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c3fab94f-78f6-4a53-b000-41f63509d8dd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:01.329689 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3fab94f-78f6-4a53-b000-41f63509d8dd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:01.330211 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3fab94f-78f6-4a53-b000-41f63509d8dd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:01.331057 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3fab94f-78f6-4a53-b000-41f63509d8dd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:01.331499 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3fab94f-78f6-4a53-b000-41f63509d8dd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:01.758070 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:01.775329 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:01.781935 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:01.783379 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9422c7a8-0a61-481a-8a6f-e7838434b59c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.522733 Feb 28 10:35:01.789868 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 260/484] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:01 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:35:01.794802 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c3fab94f-78f6-4a53-b000-41f63509d8dd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:01.796273 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-33614610-4d33-4246-ae63-e732e61ec84a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:01.797338 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-33614610-4d33-4246-ae63-e732e61ec84a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:01.804331 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-33614610-4d33-4246-ae63-e732e61ec84a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:01.805030 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-33614610-4d33-4246-ae63-e732e61ec84a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:01.806008 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-33614610-4d33-4246-ae63-e732e61ec84a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:01.806628 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-33614610-4d33-4246-ae63-e732e61ec84a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:01.807308 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c3fab94f-78f6-4a53-b000-41f63509d8dd tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.489657 Feb 28 10:35:01.816769 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 225/485] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:01 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:02.101602 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-33614610-4d33-4246-ae63-e732e61ec84a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:02.113058 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-33614610-4d33-4246-ae63-e732e61ec84a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.321359 Feb 28 10:35:02.113969 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 261/486] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:01 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:02.266517 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-86016116-f495-4506-9159-453f9dc78d27 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:02.267235 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-86016116-f495-4506-9159-453f9dc78d27 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:02.273611 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-86016116-f495-4506-9159-453f9dc78d27 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:02.274136 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-86016116-f495-4506-9159-453f9dc78d27 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:02.275051 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-86016116-f495-4506-9159-453f9dc78d27 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:02.275546 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-86016116-f495-4506-9159-453f9dc78d27 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:02.303331 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-dbb3ea12-1d47-4c1f-9e2a-6f2cbb6dbbfa tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:02.304356 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-dbb3ea12-1d47-4c1f-9e2a-6f2cbb6dbbfa tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:02.311657 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-dbb3ea12-1d47-4c1f-9e2a-6f2cbb6dbbfa tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:02.312107 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-dbb3ea12-1d47-4c1f-9e2a-6f2cbb6dbbfa tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:02.312919 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-dbb3ea12-1d47-4c1f-9e2a-6f2cbb6dbbfa tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:02.313378 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-dbb3ea12-1d47-4c1f-9e2a-6f2cbb6dbbfa tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:02.506074 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-86016116-f495-4506-9159-453f9dc78d27 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:02.513640 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-86016116-f495-4506-9159-453f9dc78d27 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.252202 Feb 28 10:35:02.516370 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 226/487] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:02 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:02.539641 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-dbb3ea12-1d47-4c1f-9e2a-6f2cbb6dbbfa tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:02.547623 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-dbb3ea12-1d47-4c1f-9e2a-6f2cbb6dbbfa tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.247983 Feb 28 10:35:02.548419 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 262/488] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:02 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:02.806380 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:02.807031 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:02.813853 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:02.814302 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:02.815123 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:02.815560 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:02.824170 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-aa73403b-ea4e-4e74-9c21-2d91a3fbeac7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:02.825535 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-aa73403b-ea4e-4e74-9c21-2d91a3fbeac7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:02.831475 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aa73403b-ea4e-4e74-9c21-2d91a3fbeac7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:02.831926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aa73403b-ea4e-4e74-9c21-2d91a3fbeac7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:02.832718 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aa73403b-ea4e-4e74-9c21-2d91a3fbeac7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:02.833153 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aa73403b-ea4e-4e74-9c21-2d91a3fbeac7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:03.024667 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:03.028042 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-aa73403b-ea4e-4e74-9c21-2d91a3fbeac7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:03.034002 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:03.035395 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-aa73403b-ea4e-4e74-9c21-2d91a3fbeac7 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.215118 Feb 28 10:35:03.035976 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 263/489] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:02 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:03.036113 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:03.037768 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0f3102de-5932-4013-895c-95b138457f9e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.235368 Feb 28 10:35:03.038369 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 227/490] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:02 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:35:03.132899 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-da65f9a8-ac32-448d-a944-1fed6398542a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:03.133511 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-da65f9a8-ac32-448d-a944-1fed6398542a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:03.139798 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-da65f9a8-ac32-448d-a944-1fed6398542a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:03.140258 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-da65f9a8-ac32-448d-a944-1fed6398542a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:03.141170 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-da65f9a8-ac32-448d-a944-1fed6398542a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:03.141616 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-da65f9a8-ac32-448d-a944-1fed6398542a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:03.278297 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-da65f9a8-ac32-448d-a944-1fed6398542a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:03.285588 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-da65f9a8-ac32-448d-a944-1fed6398542a tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.156506 Feb 28 10:35:03.286153 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 264/491] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:03 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:03.530431 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7da4c5e8-6566-4850-896f-79f2ce3e19c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:03.531043 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7da4c5e8-6566-4850-896f-79f2ce3e19c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:03.537319 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7da4c5e8-6566-4850-896f-79f2ce3e19c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:03.537766 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7da4c5e8-6566-4850-896f-79f2ce3e19c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:03.538554 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7da4c5e8-6566-4850-896f-79f2ce3e19c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:03.539016 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7da4c5e8-6566-4850-896f-79f2ce3e19c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:03.565301 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-313eb197-e605-46f0-ba4c-77752e1c5907 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:03.566045 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-313eb197-e605-46f0-ba4c-77752e1c5907 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:03.572533 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-313eb197-e605-46f0-ba4c-77752e1c5907 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:03.572981 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-313eb197-e605-46f0-ba4c-77752e1c5907 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:03.573791 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-313eb197-e605-46f0-ba4c-77752e1c5907 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:03.574232 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-313eb197-e605-46f0-ba4c-77752e1c5907 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:03.985429 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7da4c5e8-6566-4850-896f-79f2ce3e19c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:03.993212 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7da4c5e8-6566-4850-896f-79f2ce3e19c4 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.466706 Feb 28 10:35:04.002939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 228/492] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:03 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:04.014848 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-313eb197-e605-46f0-ba4c-77752e1c5907 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:04.022134 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-313eb197-e605-46f0-ba4c-77752e1c5907 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.460840 Feb 28 10:35:04.022983 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 265/493] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:03 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:04.053393 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8d47e22f-e022-4b60-874d-ddbeb1747832 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:04.054174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8d47e22f-e022-4b60-874d-ddbeb1747832 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:04.056034 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:04.056643 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:04.061750 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8d47e22f-e022-4b60-874d-ddbeb1747832 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:04.062503 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8d47e22f-e022-4b60-874d-ddbeb1747832 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:04.063052 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:04.063469 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8d47e22f-e022-4b60-874d-ddbeb1747832 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:04.063574 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:04.063987 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8d47e22f-e022-4b60-874d-ddbeb1747832 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:04.064266 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:04.064701 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:04.505163 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8d47e22f-e022-4b60-874d-ddbeb1747832 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:04.514404 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8d47e22f-e022-4b60-874d-ddbeb1747832 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1470 microversion: 2.1 time: 0.464993 Feb 28 10:35:04.524116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 229/494] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:04 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1470 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:04.534751 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:04.539746 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e5afe1bc-1d61-4af8-b9de-005419e8fdbe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:04.540958 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e5afe1bc-1d61-4af8-b9de-005419e8fdbe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:04.549382 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e5afe1bc-1d61-4af8-b9de-005419e8fdbe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:04.550079 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e5afe1bc-1d61-4af8-b9de-005419e8fdbe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:04.551080 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e5afe1bc-1d61-4af8-b9de-005419e8fdbe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:04.551677 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e5afe1bc-1d61-4af8-b9de-005419e8fdbe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:04.563087 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:04.565572 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:04.567241 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-739ba89a-1383-40ca-a6a3-94cebaf863da tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.514822 Feb 28 10:35:04.567940 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 266/495] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:04 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:35:04.926519 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e5afe1bc-1d61-4af8-b9de-005419e8fdbe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:04.949261 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e5afe1bc-1d61-4af8-b9de-005419e8fdbe tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 200 len: 1507 microversion: 2.1 time: 0.418905 Feb 28 10:35:04.951017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 230/496] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:04 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 1507 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:05.010480 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-cbb7117d-68a1-4e3f-9c0e-9421ebe399cc tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:05.011134 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-cbb7117d-68a1-4e3f-9c0e-9421ebe399cc tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:05.019901 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-d84c5641-a970-48fb-9db7-a70e51fa06f4 req-2956049c-3e48-4584-801f-312a1930479a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a106010-a1a1-4a6b-85b0-7788c63b00b3", "name": "network-vif-deleted", "tag": "21d2234b-c39e-4863-b298-1fbac7193271"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:05.046043 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbb7117d-68a1-4e3f-9c0e-9421ebe399cc tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.047285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbb7117d-68a1-4e3f-9c0e-9421ebe399cc tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.048580 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbb7117d-68a1-4e3f-9c0e-9421ebe399cc tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.049528 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbb7117d-68a1-4e3f-9c0e-9421ebe399cc tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.055970 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-d84c5641-a970-48fb-9db7-a70e51fa06f4 req-2956049c-3e48-4584-801f-312a1930479a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.056581 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-d84c5641-a970-48fb-9db7-a70e51fa06f4 req-2956049c-3e48-4584-801f-312a1930479a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.085296 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-d84c5641-a970-48fb-9db7-a70e51fa06f4 req-2956049c-3e48-4584-801f-312a1930479a service nova] Creating event network-vif-deleted:21d2234b-c39e-4863-b298-1fbac7193271 for instance 2a106010-a1a1-4a6b-85b0-7788c63b00b3 on hv-cinder-maste Feb 28 10:35:05.104384 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-d84c5641-a970-48fb-9db7-a70e51fa06f4 req-2956049c-3e48-4584-801f-312a1930479a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088498 Feb 28 10:35:05.113990 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 231/497] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:35:05.125801 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-36977655-9d9d-4864-aca6-449546e15cf3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:05.127581 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-36977655-9d9d-4864-aca6-449546e15cf3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:05.154779 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-36977655-9d9d-4864-aca6-449546e15cf3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.156288 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-36977655-9d9d-4864-aca6-449546e15cf3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.158540 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-36977655-9d9d-4864-aca6-449546e15cf3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.160182 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-36977655-9d9d-4864-aca6-449546e15cf3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.384993 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-cbb7117d-68a1-4e3f-9c0e-9421ebe399cc tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:05.396255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-cbb7117d-68a1-4e3f-9c0e-9421ebe399cc tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.389440 Feb 28 10:35:05.396971 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 267/498] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:05 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:05.402141 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-1fc35ebe-abf3-45a9-8183-a51621ba6018 req-9cd87338-5951-4622-ac98-347e7d62d4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7de27a-2095-46ac-ade5-992422ccbb4e", "name": "network-vif-deleted", "tag": "a59d6bed-3809-43c1-b057-c4e3bf30676c"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:05.421276 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-36977655-9d9d-4864-aca6-449546e15cf3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:05.429681 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-36977655-9d9d-4864-aca6-449546e15cf3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.314203 Feb 28 10:35:05.430256 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 232/499] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:05 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:05.431109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-1fc35ebe-abf3-45a9-8183-a51621ba6018 req-9cd87338-5951-4622-ac98-347e7d62d4f0 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.431755 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-1fc35ebe-abf3-45a9-8183-a51621ba6018 req-9cd87338-5951-4622-ac98-347e7d62d4f0 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.444551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-1fc35ebe-abf3-45a9-8183-a51621ba6018 req-9cd87338-5951-4622-ac98-347e7d62d4f0 service nova] Creating event network-vif-deleted:a59d6bed-3809-43c1-b057-c4e3bf30676c for instance ae7de27a-2095-46ac-ade5-992422ccbb4e on hv-cinder-maste Feb 28 10:35:05.450468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-1fc35ebe-abf3-45a9-8183-a51621ba6018 req-9cd87338-5951-4622-ac98-347e7d62d4f0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052027 Feb 28 10:35:05.451197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 268/500] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:05.531761 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:05.532507 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:05.538974 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.539436 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.540361 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.541037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.573814 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.574268 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.574750 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lazy-loading 'fault' on Instance uuid 2a106010-a1a1-4a6b-85b0-7788c63b00b3 {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:35:05.585805 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:05.586773 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:05.593709 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.594166 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.594987 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.595622 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.624813 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f75162c65b4e96a113adb0e1b2d11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5064c06558bb43eead0db5aa0ce93841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:05.633201 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3d397394-2002-4c88-bea0-bacf49c34026 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 200 len: 1305 microversion: 2.1 time: 0.106273 Feb 28 10:35:05.633842 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 233/501] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:05 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:05.743028 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:05.753870 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:05.755452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:05.756885 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-cd81759f-c291-4a60-a14c-cb2cb3fa8f6c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.175363 Feb 28 10:35:05.757873 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 269/502] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:05 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:35:05.966064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2d6535d6-aae8-4298-9496-99765341f7ea tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:05.966592 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2d6535d6-aae8-4298-9496-99765341f7ea tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: ae7de27a-2095-46ac-ade5-992422ccbb4e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:05.972462 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d6535d6-aae8-4298-9496-99765341f7ea tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.972913 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d6535d6-aae8-4298-9496-99765341f7ea tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.973688 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d6535d6-aae8-4298-9496-99765341f7ea tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:05.974151 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d6535d6-aae8-4298-9496-99765341f7ea tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:05.987772 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-2d6535d6-aae8-4298-9496-99765341f7ea tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] HTTP exception thrown: Instance ae7de27a-2095-46ac-ade5-992422ccbb4e could not be found. Feb 28 10:35:05.988376 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2d6535d6-aae8-4298-9496-99765341f7ea tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Returning 404 to user: Instance ae7de27a-2095-46ac-ade5-992422ccbb4e could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:35:05.989187 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2d6535d6-aae8-4298-9496-99765341f7ea tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e" status: 404 len: 111 microversion: 2.1 time: 0.027436 Feb 28 10:35:05.989715 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 234/503] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:05 2022] GET /compute/v2.1/servers/ae7de27a-2095-46ac-ade5-992422ccbb4e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:35:05.998202 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-fef58094-b1c3-48db-8343-fef906640c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:05.998733 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-fef58094-b1c3-48db-8343-fef906640c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:06.004573 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fef58094-b1c3-48db-8343-fef906640c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.005014 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fef58094-b1c3-48db-8343-fef906640c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.005784 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fef58094-b1c3-48db-8343-fef906640c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.006215 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fef58094-b1c3-48db-8343-fef906640c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.029838 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-fef58094-b1c3-48db-8343-fef906640c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:35:06.101071 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-fef58094-b1c3-48db-8343-fef906640c42 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 204 len: 0 microversion: 2.1 time: 0.106990 Feb 28 10:35:06.101817 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 270/504] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:35:05 2022] DELETE /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:35:06.111022 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-dd3141c5-4b9e-4df7-a7bb-0ed7f4ef7297 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:06.111641 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-dd3141c5-4b9e-4df7-a7bb-0ed7f4ef7297 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:06.117674 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dd3141c5-4b9e-4df7-a7bb-0ed7f4ef7297 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.118128 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dd3141c5-4b9e-4df7-a7bb-0ed7f4ef7297 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.118949 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dd3141c5-4b9e-4df7-a7bb-0ed7f4ef7297 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.119387 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dd3141c5-4b9e-4df7-a7bb-0ed7f4ef7297 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.251314 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-dd3141c5-4b9e-4df7-a7bb-0ed7f4ef7297 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:06.258765 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-dd3141c5-4b9e-4df7-a7bb-0ed7f4ef7297 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.152932 Feb 28 10:35:06.259332 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 235/505] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:06 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:06.414045 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-76cbc9b3-926f-4879-82c6-2dc67b330796 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:06.414785 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-76cbc9b3-926f-4879-82c6-2dc67b330796 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:06.421846 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-76cbc9b3-926f-4879-82c6-2dc67b330796 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.422248 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-76cbc9b3-926f-4879-82c6-2dc67b330796 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.423093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-76cbc9b3-926f-4879-82c6-2dc67b330796 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.423542 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-76cbc9b3-926f-4879-82c6-2dc67b330796 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.448452 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-646b23dc-4dfa-4185-9fbc-1d6b35845173 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:06.449254 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-646b23dc-4dfa-4185-9fbc-1d6b35845173 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:06.456616 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-646b23dc-4dfa-4185-9fbc-1d6b35845173 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.457073 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-646b23dc-4dfa-4185-9fbc-1d6b35845173 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.457862 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-646b23dc-4dfa-4185-9fbc-1d6b35845173 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.458407 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-646b23dc-4dfa-4185-9fbc-1d6b35845173 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.644650 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-76cbc9b3-926f-4879-82c6-2dc67b330796 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:06.652662 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-76cbc9b3-926f-4879-82c6-2dc67b330796 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.242780 Feb 28 10:35:06.653397 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 271/506] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:06 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:06.653885 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-646b23dc-4dfa-4185-9fbc-1d6b35845173 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:06.657923 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-91df98a2-8e03-4c54-913a-01028764a6b3 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:06.658707 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-91df98a2-8e03-4c54-913a-01028764a6b3 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] [instance: 2a106010-a1a1-4a6b-85b0-7788c63b00b3] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:06.665463 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-91df98a2-8e03-4c54-913a-01028764a6b3 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.665617 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-646b23dc-4dfa-4185-9fbc-1d6b35845173 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.222147 Feb 28 10:35:06.665920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-91df98a2-8e03-4c54-913a-01028764a6b3 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.666173 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 236/507] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:06 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:06.671890 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-91df98a2-8e03-4c54-913a-01028764a6b3 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.672327 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-91df98a2-8e03-4c54-913a-01028764a6b3 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.687929 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-91df98a2-8e03-4c54-913a-01028764a6b3 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] HTTP exception thrown: Instance 2a106010-a1a1-4a6b-85b0-7788c63b00b3 could not be found. Feb 28 10:35:06.688530 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-91df98a2-8e03-4c54-913a-01028764a6b3 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] Returning 404 to user: Instance 2a106010-a1a1-4a6b-85b0-7788c63b00b3 could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:35:06.689324 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-91df98a2-8e03-4c54-913a-01028764a6b3 tempest-VolumesNegativeTest-1031525326 tempest-VolumesNegativeTest-1031525326-project] 10.222.0.21 "GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3" status: 404 len: 111 microversion: 2.1 time: 0.034853 Feb 28 10:35:06.689873 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 272/508] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:06 2022] GET /compute/v2.1/servers/2a106010-a1a1-4a6b-85b0-7788c63b00b3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:35:06.777147 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:06.777876 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:06.783826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.784281 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.785074 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:06.785501 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:06.942005 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:06.955774 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:06.957710 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:06.959476 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9c195c39-99e5-44ef-b37e-664eac50ce5d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.186040 Feb 28 10:35:06.963469 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 237/509] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:06 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:35:07.129196 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-ecaaedf7-d8e0-4bac-aa55-bb2e8523d07f req-9aab7000-72e0-4e1a-aa68-68993a81ad99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1e2144-30f4-491e-a85f-59b429f9879b", "tag": "4b9ee076-d1ee-4590-80a3-6e8e06acb5ce"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:07.142337 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-ecaaedf7-d8e0-4bac-aa55-bb2e8523d07f req-9aab7000-72e0-4e1a-aa68-68993a81ad99 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:07.143054 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-ecaaedf7-d8e0-4bac-aa55-bb2e8523d07f req-9aab7000-72e0-4e1a-aa68-68993a81ad99 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:07.162681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-ecaaedf7-d8e0-4bac-aa55-bb2e8523d07f req-9aab7000-72e0-4e1a-aa68-68993a81ad99 service nova] Creating event network-changed:4b9ee076-d1ee-4590-80a3-6e8e06acb5ce for instance ba1e2144-30f4-491e-a85f-59b429f9879b on hv-cinder-maste Feb 28 10:35:07.168974 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-ecaaedf7-d8e0-4bac-aa55-bb2e8523d07f req-9aab7000-72e0-4e1a-aa68-68993a81ad99 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043063 Feb 28 10:35:07.169876 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 273/510] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:07.276729 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-43510c99-8f2d-4c4d-871c-2351065ec472 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:07.281085 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-43510c99-8f2d-4c4d-871c-2351065ec472 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:07.287407 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-43510c99-8f2d-4c4d-871c-2351065ec472 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:07.288004 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-43510c99-8f2d-4c4d-871c-2351065ec472 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:07.289064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-43510c99-8f2d-4c4d-871c-2351065ec472 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:07.289579 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-43510c99-8f2d-4c4d-871c-2351065ec472 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:07.467833 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-43510c99-8f2d-4c4d-871c-2351065ec472 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:07.476697 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-43510c99-8f2d-4c4d-871c-2351065ec472 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.204113 Feb 28 10:35:07.478586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 238/511] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:07 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:07.672688 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-72877dc6-79e7-4a60-993b-3421a429039e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:07.674127 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-72877dc6-79e7-4a60-993b-3421a429039e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:07.682249 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72877dc6-79e7-4a60-993b-3421a429039e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:07.683285 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c35b38f9-adbf-4ef6-b8d0-e2d0d5e16070 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:07.684454 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c35b38f9-adbf-4ef6-b8d0-e2d0d5e16070 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:07.685798 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72877dc6-79e7-4a60-993b-3421a429039e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:07.687179 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72877dc6-79e7-4a60-993b-3421a429039e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:07.687869 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72877dc6-79e7-4a60-993b-3421a429039e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:07.696773 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c35b38f9-adbf-4ef6-b8d0-e2d0d5e16070 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:07.697511 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c35b38f9-adbf-4ef6-b8d0-e2d0d5e16070 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:07.698486 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c35b38f9-adbf-4ef6-b8d0-e2d0d5e16070 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:07.703326 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c35b38f9-adbf-4ef6-b8d0-e2d0d5e16070 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:07.896965 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-72877dc6-79e7-4a60-993b-3421a429039e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:07.905339 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-72877dc6-79e7-4a60-993b-3421a429039e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.239705 Feb 28 10:35:07.906100 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 274/512] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:07 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:07.935820 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c35b38f9-adbf-4ef6-b8d0-e2d0d5e16070 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:07.944222 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c35b38f9-adbf-4ef6-b8d0-e2d0d5e16070 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.265622 Feb 28 10:35:07.944788 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 239/513] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:07 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:07.981398 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:07.982428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:07.991786 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:07.992502 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:07.993734 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:07.994440 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:08.138500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:08.147627 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:08.149133 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:08.150274 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ed721cd1-4cfb-4f26-9baf-4ff47640ab81 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.176425 Feb 28 10:35:08.150852 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 275/514] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:07 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:35:08.495739 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6ebfd50e-4eef-4b49-9a6a-bc70cc4f8a8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:08.497314 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6ebfd50e-4eef-4b49-9a6a-bc70cc4f8a8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:08.503985 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6ebfd50e-4eef-4b49-9a6a-bc70cc4f8a8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:08.504525 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6ebfd50e-4eef-4b49-9a6a-bc70cc4f8a8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:08.505438 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6ebfd50e-4eef-4b49-9a6a-bc70cc4f8a8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:08.506030 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6ebfd50e-4eef-4b49-9a6a-bc70cc4f8a8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:08.667579 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6ebfd50e-4eef-4b49-9a6a-bc70cc4f8a8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:08.675268 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6ebfd50e-4eef-4b49-9a6a-bc70cc4f8a8d tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.183389 Feb 28 10:35:08.676450 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 240/515] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:08 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:08.707754 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-b39834da-79d9-427b-aeb2-c0e3e9474eab req-94012292-03e1-47ad-9c15-c700096a1f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ead279e-e2e9-4312-a47a-fbec064ce99b", "name": "network-vif-plugged", "status": "completed", "tag": "76aed61f-8cd7-4455-a163-d78d7f320a35"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:08.718165 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-b39834da-79d9-427b-aeb2-c0e3e9474eab req-94012292-03e1-47ad-9c15-c700096a1f9f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:08.718646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-b39834da-79d9-427b-aeb2-c0e3e9474eab req-94012292-03e1-47ad-9c15-c700096a1f9f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:08.730771 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-b39834da-79d9-427b-aeb2-c0e3e9474eab req-94012292-03e1-47ad-9c15-c700096a1f9f service nova] Creating event network-vif-plugged:76aed61f-8cd7-4455-a163-d78d7f320a35 for instance 1ead279e-e2e9-4312-a47a-fbec064ce99b on hv-cinder-maste Feb 28 10:35:08.736433 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-b39834da-79d9-427b-aeb2-c0e3e9474eab req-94012292-03e1-47ad-9c15-c700096a1f9f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034058 Feb 28 10:35:08.737073 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 276/516] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:08.926397 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9784ef94-2bb1-4449-bff0-bc9426db8b39 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:08.927042 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9784ef94-2bb1-4449-bff0-bc9426db8b39 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:08.932953 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9784ef94-2bb1-4449-bff0-bc9426db8b39 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:08.933402 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9784ef94-2bb1-4449-bff0-bc9426db8b39 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:08.934894 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9784ef94-2bb1-4449-bff0-bc9426db8b39 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:08.935333 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9784ef94-2bb1-4449-bff0-bc9426db8b39 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:08.963882 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-504998bd-d871-4445-bf0a-9b43fd74558d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:08.965560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-504998bd-d871-4445-bf0a-9b43fd74558d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:08.972037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-504998bd-d871-4445-bf0a-9b43fd74558d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:08.972934 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-504998bd-d871-4445-bf0a-9b43fd74558d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:08.973916 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-504998bd-d871-4445-bf0a-9b43fd74558d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:08.974515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-504998bd-d871-4445-bf0a-9b43fd74558d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:09.152035 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9784ef94-2bb1-4449-bff0-bc9426db8b39 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:09.160823 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9784ef94-2bb1-4449-bff0-bc9426db8b39 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.243199 Feb 28 10:35:09.162323 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 241/517] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:08 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:09.186456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:09.186456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:09.201064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:09.202856 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:09.205250 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:09.206669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:09.209772 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-504998bd-d871-4445-bf0a-9b43fd74558d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:09.223452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-504998bd-d871-4445-bf0a-9b43fd74558d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.265857 Feb 28 10:35:09.226636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 277/518] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:08 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:09.413839 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:09.423796 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:09.425312 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:09.426481 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9ee2dd6c-74e4-4341-b025-3fa243ef1f73 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.253194 Feb 28 10:35:09.427100 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 242/519] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:09 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:35:09.694504 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-494a56ee-fb39-4740-af0d-8f12c98cfff7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:09.695285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-494a56ee-fb39-4740-af0d-8f12c98cfff7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:09.702246 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-494a56ee-fb39-4740-af0d-8f12c98cfff7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:09.702943 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-494a56ee-fb39-4740-af0d-8f12c98cfff7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:09.703906 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-494a56ee-fb39-4740-af0d-8f12c98cfff7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:09.704345 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-494a56ee-fb39-4740-af0d-8f12c98cfff7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:09.848197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-494a56ee-fb39-4740-af0d-8f12c98cfff7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:09.855761 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-494a56ee-fb39-4740-af0d-8f12c98cfff7 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.165013 Feb 28 10:35:09.856322 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 278/520] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:09 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:10.178728 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-47172de4-763c-4b13-adcd-c5661dc6cae8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:10.179255 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-47172de4-763c-4b13-adcd-c5661dc6cae8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:10.186055 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-47172de4-763c-4b13-adcd-c5661dc6cae8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:10.186498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-47172de4-763c-4b13-adcd-c5661dc6cae8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:10.187330 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-47172de4-763c-4b13-adcd-c5661dc6cae8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:10.187762 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-47172de4-763c-4b13-adcd-c5661dc6cae8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:10.242293 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-00fe7a1f-408b-4d71-ad5c-55e677cc8796 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:10.244075 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-00fe7a1f-408b-4d71-ad5c-55e677cc8796 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:10.250682 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-00fe7a1f-408b-4d71-ad5c-55e677cc8796 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:10.251133 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-00fe7a1f-408b-4d71-ad5c-55e677cc8796 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:10.251927 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-00fe7a1f-408b-4d71-ad5c-55e677cc8796 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:10.252364 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-00fe7a1f-408b-4d71-ad5c-55e677cc8796 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:10.353344 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-47172de4-763c-4b13-adcd-c5661dc6cae8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:10.361683 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-47172de4-763c-4b13-adcd-c5661dc6cae8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.186690 Feb 28 10:35:10.362833 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 243/521] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:10 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:10.424062 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-00fe7a1f-408b-4d71-ad5c-55e677cc8796 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:10.431455 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-00fe7a1f-408b-4d71-ad5c-55e677cc8796 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.193033 Feb 28 10:35:10.431956 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 279/522] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:10 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:10.445167 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:10.445808 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:10.452376 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:10.452829 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:10.453610 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:10.454046 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:10.589798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:10.598053 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:10.599579 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:10.600759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5751beac-e525-484e-bcbc-13c11d17a219 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.159439 Feb 28 10:35:10.601277 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 244/523] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:10 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:35:10.750988 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-22217c63-1d81-4a1e-86cc-7265b8a86fd9 req-dff10823-25e1-4105-8a50-21db3f8754de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1e2144-30f4-491e-a85f-59b429f9879b", "name": "network-vif-plugged", "status": "completed", "tag": "4b9ee076-d1ee-4590-80a3-6e8e06acb5ce"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:10.758840 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-22217c63-1d81-4a1e-86cc-7265b8a86fd9 req-dff10823-25e1-4105-8a50-21db3f8754de service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:10.759277 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-22217c63-1d81-4a1e-86cc-7265b8a86fd9 req-dff10823-25e1-4105-8a50-21db3f8754de service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:10.770116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-22217c63-1d81-4a1e-86cc-7265b8a86fd9 req-dff10823-25e1-4105-8a50-21db3f8754de service nova] Creating event network-vif-plugged:4b9ee076-d1ee-4590-80a3-6e8e06acb5ce for instance ba1e2144-30f4-491e-a85f-59b429f9879b on hv-cinder-maste Feb 28 10:35:10.775127 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-22217c63-1d81-4a1e-86cc-7265b8a86fd9 req-dff10823-25e1-4105-8a50-21db3f8754de service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027836 Feb 28 10:35:10.775691 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 280/524] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:10.871884 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-259668c1-5f60-44fe-9609-ae030d7e21b2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:10.873123 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-259668c1-5f60-44fe-9609-ae030d7e21b2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:10.879304 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-259668c1-5f60-44fe-9609-ae030d7e21b2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:10.890733 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-259668c1-5f60-44fe-9609-ae030d7e21b2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:10.891880 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-259668c1-5f60-44fe-9609-ae030d7e21b2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:10.892327 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-259668c1-5f60-44fe-9609-ae030d7e21b2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:11.036158 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-259668c1-5f60-44fe-9609-ae030d7e21b2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:11.043670 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-259668c1-5f60-44fe-9609-ae030d7e21b2 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.175618 Feb 28 10:35:11.044197 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 245/525] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:10 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:11.380297 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-aa6f4897-170e-49b4-8918-03ac88c43a74 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:11.381111 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-aa6f4897-170e-49b4-8918-03ac88c43a74 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:11.388861 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aa6f4897-170e-49b4-8918-03ac88c43a74 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:11.389301 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aa6f4897-170e-49b4-8918-03ac88c43a74 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:11.390303 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aa6f4897-170e-49b4-8918-03ac88c43a74 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:11.390795 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aa6f4897-170e-49b4-8918-03ac88c43a74 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:11.448269 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-1ae41286-1426-4392-80c3-74991d699c47 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:11.448889 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-1ae41286-1426-4392-80c3-74991d699c47 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:11.456169 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1ae41286-1426-4392-80c3-74991d699c47 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:11.456937 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1ae41286-1426-4392-80c3-74991d699c47 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:11.457978 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1ae41286-1426-4392-80c3-74991d699c47 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:11.458782 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1ae41286-1426-4392-80c3-74991d699c47 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:11.712112 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-1ae41286-1426-4392-80c3-74991d699c47 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:11.716847 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-aa6f4897-170e-49b4-8918-03ac88c43a74 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:11.721054 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-1ae41286-1426-4392-80c3-74991d699c47 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.276661 Feb 28 10:35:11.730174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 246/526] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:11 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:11.730174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:11.730174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:11.733417 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-aa6f4897-170e-49b4-8918-03ac88c43a74 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.357732 Feb 28 10:35:11.733649 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:11.734195 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:11.742914 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 281/527] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:11 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:11.743084 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:11.743084 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:11.889976 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:11.901961 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:11.904087 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:11.905297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7b2b2c2e-d401-4d61-aa61-fda0a5c56b27 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1808 microversion: 2.20 time: 0.182424 Feb 28 10:35:11.906054 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 247/528] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:11 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:35:12.061529 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c17ebc62-9862-4b7b-b7cb-d203c22b3ecf tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:12.062161 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c17ebc62-9862-4b7b-b7cb-d203c22b3ecf tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:12.068014 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c17ebc62-9862-4b7b-b7cb-d203c22b3ecf tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:12.068454 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c17ebc62-9862-4b7b-b7cb-d203c22b3ecf tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:12.069222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c17ebc62-9862-4b7b-b7cb-d203c22b3ecf tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:12.069672 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c17ebc62-9862-4b7b-b7cb-d203c22b3ecf tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:12.205432 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c17ebc62-9862-4b7b-b7cb-d203c22b3ecf tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:12.212656 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c17ebc62-9862-4b7b-b7cb-d203c22b3ecf tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.155509 Feb 28 10:35:12.213214 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 282/529] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:12 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:12.737564 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-59295d39-bfd3-4e5b-a98c-7c94d6513571 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:12.738086 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-59295d39-bfd3-4e5b-a98c-7c94d6513571 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:12.744395 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-59295d39-bfd3-4e5b-a98c-7c94d6513571 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:12.744844 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-59295d39-bfd3-4e5b-a98c-7c94d6513571 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:12.745623 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-59295d39-bfd3-4e5b-a98c-7c94d6513571 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:12.746056 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-59295d39-bfd3-4e5b-a98c-7c94d6513571 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:12.750803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c98dfd87-8d38-4e73-9a19-682f73fc36cd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:12.751415 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c98dfd87-8d38-4e73-9a19-682f73fc36cd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:12.757584 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c98dfd87-8d38-4e73-9a19-682f73fc36cd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:12.758025 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c98dfd87-8d38-4e73-9a19-682f73fc36cd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:12.758889 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c98dfd87-8d38-4e73-9a19-682f73fc36cd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:12.759320 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c98dfd87-8d38-4e73-9a19-682f73fc36cd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:12.957037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-59295d39-bfd3-4e5b-a98c-7c94d6513571 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:12.960236 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c98dfd87-8d38-4e73-9a19-682f73fc36cd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:12.964959 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-59295d39-bfd3-4e5b-a98c-7c94d6513571 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.231228 Feb 28 10:35:12.965767 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 248/530] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:12 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:12.968436 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c98dfd87-8d38-4e73-9a19-682f73fc36cd tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1357 microversion: 2.1 time: 0.221888 Feb 28 10:35:12.968990 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 283/531] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:12 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:12.970563 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:12.971425 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:12.977253 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:12.977787 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:12.978573 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:12.979034 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:13.113009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:13.121713 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:13.123389 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:13.124545 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b16abde9-d629-413d-bddc-e2101b47e272 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1795 microversion: 2.20 time: 0.157794 Feb 28 10:35:13.125107 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 249/532] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:35:12 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:35:13.229678 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0563114f-923f-4cf3-b9f3-354eaafab923 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:13.230287 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0563114f-923f-4cf3-b9f3-354eaafab923 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:13.236700 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0563114f-923f-4cf3-b9f3-354eaafab923 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:13.237148 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0563114f-923f-4cf3-b9f3-354eaafab923 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:13.237924 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0563114f-923f-4cf3-b9f3-354eaafab923 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:13.238357 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0563114f-923f-4cf3-b9f3-354eaafab923 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:13.369748 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0563114f-923f-4cf3-b9f3-354eaafab923 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:13.377130 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0563114f-923f-4cf3-b9f3-354eaafab923 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.151406 Feb 28 10:35:13.377688 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 284/533] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:13 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:13.982087 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-38f334ab-e254-444b-accf-db9bdd19d6bc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:13.982844 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-38f334ab-e254-444b-accf-db9bdd19d6bc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:13.986017 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0278b3e0-ab16-4803-91d3-3feaa151a3fa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:13.986458 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0278b3e0-ab16-4803-91d3-3feaa151a3fa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:13.989887 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38f334ab-e254-444b-accf-db9bdd19d6bc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:13.990115 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38f334ab-e254-444b-accf-db9bdd19d6bc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:13.990933 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38f334ab-e254-444b-accf-db9bdd19d6bc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:13.991367 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38f334ab-e254-444b-accf-db9bdd19d6bc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:13.999126 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0278b3e0-ab16-4803-91d3-3feaa151a3fa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:13.999692 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0278b3e0-ab16-4803-91d3-3feaa151a3fa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.000512 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0278b3e0-ab16-4803-91d3-3feaa151a3fa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.000952 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0278b3e0-ab16-4803-91d3-3feaa151a3fa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.195350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-38f334ab-e254-444b-accf-db9bdd19d6bc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:14.202541 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0278b3e0-ab16-4803-91d3-3feaa151a3fa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:14.203519 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-38f334ab-e254-444b-accf-db9bdd19d6bc tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.225556 Feb 28 10:35:14.204093 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 250/534] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:13 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:14.208800 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f4dc713e-4b03-4c71-acf4-3fa42b1490b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:14.209284 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f4dc713e-4b03-4c71-acf4-3fa42b1490b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:14.214402 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0278b3e0-ab16-4803-91d3-3feaa151a3fa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1546 microversion: 2.1 time: 0.232272 Feb 28 10:35:14.215693 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f4dc713e-4b03-4c71-acf4-3fa42b1490b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.217184 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 285/535] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:13 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1546 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:14.218382 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f4dc713e-4b03-4c71-acf4-3fa42b1490b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.218382 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f4dc713e-4b03-4c71-acf4-3fa42b1490b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.218382 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f4dc713e-4b03-4c71-acf4-3fa42b1490b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.232042 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-fae33ac1-da3c-4bfd-938d-10f65c1f1a31 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:14.232643 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-fae33ac1-da3c-4bfd-938d-10f65c1f1a31 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:14.238457 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fae33ac1-da3c-4bfd-938d-10f65c1f1a31 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.238935 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fae33ac1-da3c-4bfd-938d-10f65c1f1a31 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.239711 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fae33ac1-da3c-4bfd-938d-10f65c1f1a31 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.240138 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fae33ac1-da3c-4bfd-938d-10f65c1f1a31 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.350534 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-f4dc713e-4b03-4c71-acf4-3fa42b1490b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lazy-loading 'services' on Instance uuid eeb676a4-94b3-4550-8eb3-b12a16f6f3ec {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:35:14.391789 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-fae33ac1-da3c-4bfd-938d-10f65c1f1a31 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:14.399654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-fae33ac1-da3c-4bfd-938d-10f65c1f1a31 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1546 microversion: 2.1 time: 0.171818 Feb 28 10:35:14.411391 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 286/536] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:14 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:14.417826 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a398039e-fa3a-4398-9a2c-eee97dbfd091 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:14.429602 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a398039e-fa3a-4398-9a2c-eee97dbfd091 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:14.436825 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a398039e-fa3a-4398-9a2c-eee97dbfd091 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.437571 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a398039e-fa3a-4398-9a2c-eee97dbfd091 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.439408 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a398039e-fa3a-4398-9a2c-eee97dbfd091 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.440090 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a398039e-fa3a-4398-9a2c-eee97dbfd091 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.494432 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f4dc713e-4b03-4c71-acf4-3fa42b1490b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "DELETE /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/os-volume_attachments/c173e195-abdf-4568-bbc2-63003d486c2a" status: 202 len: 0 microversion: 2.1 time: 0.286218 Feb 28 10:35:14.496014 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 251/537] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:35:14 2022] DELETE /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/os-volume_attachments/c173e195-abdf-4568-bbc2-63003d486c2a => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:35:14.512229 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8542694e-0e71-4167-870e-da9c8f8f9c9d tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:14.521292 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8542694e-0e71-4167-870e-da9c8f8f9c9d tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:14.522145 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8542694e-0e71-4167-870e-da9c8f8f9c9d tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Searching by: {'deleted': False, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169'} {{(pid=123151) get_all /opt/stack/nova/nova/compute/api.py:2960}} Feb 28 10:35:14.533440 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8542694e-0e71-4167-870e-da9c8f8f9c9d tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.534162 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8542694e-0e71-4167-870e-da9c8f8f9c9d tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.535125 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8542694e-0e71-4167-870e-da9c8f8f9c9d tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.535846 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8542694e-0e71-4167-870e-da9c8f8f9c9d tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.657086 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a398039e-fa3a-4398-9a2c-eee97dbfd091 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:14.667015 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a398039e-fa3a-4398-9a2c-eee97dbfd091 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1522 microversion: 2.1 time: 0.253728 Feb 28 10:35:14.668836 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 287/538] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:14 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:14.681359 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-3558ae28-b986-4703-9b70-06cc05d5be9d req-a80692de-9a28-4b76-a4c5-480dcb679562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6a8a33-e76e-450b-a94a-a0852fc6472c", "name": "network-vif-plugged", "status": "completed", "tag": "c294705d-35da-4f5d-8e43-0a930f3b63a3"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:14.693197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-3558ae28-b986-4703-9b70-06cc05d5be9d req-a80692de-9a28-4b76-a4c5-480dcb679562 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.693933 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-3558ae28-b986-4703-9b70-06cc05d5be9d req-a80692de-9a28-4b76-a4c5-480dcb679562 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.708833 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-3558ae28-b986-4703-9b70-06cc05d5be9d req-a80692de-9a28-4b76-a4c5-480dcb679562 service nova] Creating event network-vif-plugged:c294705d-35da-4f5d-8e43-0a930f3b63a3 for instance 6f6a8a33-e76e-450b-a94a-a0852fc6472c on hv-cinder-maste Feb 28 10:35:14.712316 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.multi_cell_list [None req-8542694e-0e71-4167-870e-da9c8f8f9c9d tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123151) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 28 10:35:14.715999 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-3558ae28-b986-4703-9b70-06cc05d5be9d req-a80692de-9a28-4b76-a4c5-480dcb679562 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044857 Feb 28 10:35:14.721476 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 288/539] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:14.812146 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8542694e-0e71-4167-870e-da9c8f8f9c9d tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.314141 Feb 28 10:35:14.812728 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 252/540] 10.222.0.21 () {58 vars in 1124 bytes} [Mon Feb 28 10:35:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:14.823895 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-139896b6-7d08-4697-bea9-21b3c91e4ae6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:14.825247 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-139896b6-7d08-4697-bea9-21b3c91e4ae6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:14.831322 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-139896b6-7d08-4697-bea9-21b3c91e4ae6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.831772 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-139896b6-7d08-4697-bea9-21b3c91e4ae6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.832556 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-139896b6-7d08-4697-bea9-21b3c91e4ae6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.832991 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-139896b6-7d08-4697-bea9-21b3c91e4ae6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.919682 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-0cadb492-0892-410b-add7-7a1f3e6bb127 req-58c85e08-6934-4095-bac0-0dfbb41d8048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1560b32-2ab2-4234-aeca-5cbe2d745915", "name": "network-vif-deleted", "tag": "b4a656dd-70b4-452d-a3c9-90978f7d0dca"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:14.931738 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-0cadb492-0892-410b-add7-7a1f3e6bb127 req-58c85e08-6934-4095-bac0-0dfbb41d8048 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:14.933062 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-0cadb492-0892-410b-add7-7a1f3e6bb127 req-58c85e08-6934-4095-bac0-0dfbb41d8048 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:14.945142 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-0cadb492-0892-410b-add7-7a1f3e6bb127 req-58c85e08-6934-4095-bac0-0dfbb41d8048 service nova] Creating event network-vif-deleted:b4a656dd-70b4-452d-a3c9-90978f7d0dca for instance e1560b32-2ab2-4234-aeca-5cbe2d745915 on hv-cinder-maste Feb 28 10:35:14.951353 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-0cadb492-0892-410b-add7-7a1f3e6bb127 req-58c85e08-6934-4095-bac0-0dfbb41d8048 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037898 Feb 28 10:35:14.952577 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 253/541] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:14.990683 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-139896b6-7d08-4697-bea9-21b3c91e4ae6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:14.998486 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-139896b6-7d08-4697-bea9-21b3c91e4ae6 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1546 microversion: 2.1 time: 0.178774 Feb 28 10:35:14.999093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 289/542] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:14 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1546 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:15.222368 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-481d911f-1a22-40b3-87a0-8e278fb75e66 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:15.223100 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-481d911f-1a22-40b3-87a0-8e278fb75e66 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:15.230067 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-481d911f-1a22-40b3-87a0-8e278fb75e66 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:15.230584 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-481d911f-1a22-40b3-87a0-8e278fb75e66 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:15.232104 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-481d911f-1a22-40b3-87a0-8e278fb75e66 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:15.232681 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-481d911f-1a22-40b3-87a0-8e278fb75e66 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:15.377477 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-481d911f-1a22-40b3-87a0-8e278fb75e66 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:15.384869 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-481d911f-1a22-40b3-87a0-8e278fb75e66 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.167542 Feb 28 10:35:15.385424 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 254/543] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:15 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:15.684114 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:15.684754 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:15.691384 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:15.691833 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:15.692608 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:15.693046 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:15.723302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:15.723747 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:15.724189 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lazy-loading 'fault' on Instance uuid e1560b32-2ab2-4234-aeca-5cbe2d745915 {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:35:15.766401 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28641197fb9b472dbe0aecd4dac3f4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77d7fba24894206bc824b8dd499e696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:15.773566 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-661ea87c-55eb-469c-b805-888651ffb2d3 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 200 len: 1311 microversion: 2.1 time: 0.093336 Feb 28 10:35:15.774130 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 290/544] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:15 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:16.401378 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-74b9f9ae-74e8-4032-9845-b446af37be14 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:16.402545 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-74b9f9ae-74e8-4032-9845-b446af37be14 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:16.409213 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74b9f9ae-74e8-4032-9845-b446af37be14 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:16.409635 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74b9f9ae-74e8-4032-9845-b446af37be14 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:16.410465 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74b9f9ae-74e8-4032-9845-b446af37be14 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:16.410951 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74b9f9ae-74e8-4032-9845-b446af37be14 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:16.523843 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-12d4e933-2db5-48e3-9d64-2555cd3dee49 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31e74ecf-1eae-4686-847c-f02b1117e44f"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:16.524902 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-12d4e933-2db5-48e3-9d64-2555cd3dee49 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:16.531928 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-12d4e933-2db5-48e3-9d64-2555cd3dee49 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:16.532378 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-12d4e933-2db5-48e3-9d64-2555cd3dee49 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:16.533160 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-12d4e933-2db5-48e3-9d64-2555cd3dee49 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:16.533681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-12d4e933-2db5-48e3-9d64-2555cd3dee49 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:16.556201 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-74b9f9ae-74e8-4032-9845-b446af37be14 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:16.563938 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-74b9f9ae-74e8-4032-9845-b446af37be14 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1260 microversion: 2.1 time: 0.166505 Feb 28 10:35:16.573522 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 255/545] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:16 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:16.790902 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d4f986fb-01fd-45e6-8ccd-cbf60fe52bd1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:16.791669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d4f986fb-01fd-45e6-8ccd-cbf60fe52bd1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] [instance: e1560b32-2ab2-4234-aeca-5cbe2d745915] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:16.792031 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-12d4e933-2db5-48e3-9d64-2555cd3dee49 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "POST /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271816 Feb 28 10:35:16.792656 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 291/546] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:35:16 2022] POST /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:35:16.797787 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d4f986fb-01fd-45e6-8ccd-cbf60fe52bd1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:16.798248 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d4f986fb-01fd-45e6-8ccd-cbf60fe52bd1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:16.799151 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d4f986fb-01fd-45e6-8ccd-cbf60fe52bd1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:16.799494 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d4f986fb-01fd-45e6-8ccd-cbf60fe52bd1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:16.813845 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-d4f986fb-01fd-45e6-8ccd-cbf60fe52bd1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] HTTP exception thrown: Instance e1560b32-2ab2-4234-aeca-5cbe2d745915 could not be found. Feb 28 10:35:16.814413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d4f986fb-01fd-45e6-8ccd-cbf60fe52bd1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] Returning 404 to user: Instance e1560b32-2ab2-4234-aeca-5cbe2d745915 could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:35:16.815274 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d4f986fb-01fd-45e6-8ccd-cbf60fe52bd1 tempest-ServerRescueNegativeTestJSON-610914936 tempest-ServerRescueNegativeTestJSON-610914936-project] 10.222.0.21 "GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915" status: 404 len: 111 microversion: 2.1 time: 0.028200 Feb 28 10:35:16.815824 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 256/547] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:16 2022] GET /compute/v2.1/servers/e1560b32-2ab2-4234-aeca-5cbe2d745915 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 10:35:16.930306 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5e796180-3e62-4629-a6ee-12f066ace4e0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:16.939074 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5e796180-3e62-4629-a6ee-12f066ace4e0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:16.939628 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5e796180-3e62-4629-a6ee-12f066ace4e0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:16.963234 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5e796180-3e62-4629-a6ee-12f066ace4e0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Going to try to stop instance {{(pid=123152) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Feb 28 10:35:17.009190 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5e796180-3e62-4629-a6ee-12f066ace4e0 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/action" status: 202 len: 0 microversion: 2.1 time: 0.083046 Feb 28 10:35:17.010094 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 292/548] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:35:16 2022] POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:35:17.018682 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e3940bc8-9219-47bd-8dea-9e47ad06b927 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:17.019441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e3940bc8-9219-47bd-8dea-9e47ad06b927 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:17.025612 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e3940bc8-9219-47bd-8dea-9e47ad06b927 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:17.026067 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e3940bc8-9219-47bd-8dea-9e47ad06b927 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:17.026896 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e3940bc8-9219-47bd-8dea-9e47ad06b927 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:17.027337 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e3940bc8-9219-47bd-8dea-9e47ad06b927 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:17.169397 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e3940bc8-9219-47bd-8dea-9e47ad06b927 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:17.177169 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e3940bc8-9219-47bd-8dea-9e47ad06b927 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1678 microversion: 2.1 time: 0.162322 Feb 28 10:35:17.178073 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 257/549] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:17 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:17.581994 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2480b5a2-9ee1-450c-a793-715282f09506 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:17.582801 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2480b5a2-9ee1-450c-a793-715282f09506 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:17.591560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2480b5a2-9ee1-450c-a793-715282f09506 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:17.591560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2480b5a2-9ee1-450c-a793-715282f09506 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:17.591560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2480b5a2-9ee1-450c-a793-715282f09506 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:17.593927 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2480b5a2-9ee1-450c-a793-715282f09506 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:17.733507 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2480b5a2-9ee1-450c-a793-715282f09506 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:17.740910 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2480b5a2-9ee1-450c-a793-715282f09506 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1445 microversion: 2.1 time: 0.163589 Feb 28 10:35:17.741495 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 293/550] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:17 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:17.757405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c17bb729-99f4-4741-93f1-8b221573d05c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:17.758116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c17bb729-99f4-4741-93f1-8b221573d05c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:17.764740 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c17bb729-99f4-4741-93f1-8b221573d05c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:17.765187 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c17bb729-99f4-4741-93f1-8b221573d05c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:17.765967 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c17bb729-99f4-4741-93f1-8b221573d05c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:17.766403 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c17bb729-99f4-4741-93f1-8b221573d05c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:17.911950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c17bb729-99f4-4741-93f1-8b221573d05c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:17.920008 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c17bb729-99f4-4741-93f1-8b221573d05c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1445 microversion: 2.1 time: 0.166398 Feb 28 10:35:17.920752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 258/551] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:17 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1445 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:18.195267 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e04b5d4a-6568-4296-917d-767756f8cdf3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:18.196141 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e04b5d4a-6568-4296-917d-767756f8cdf3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:18.204546 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e04b5d4a-6568-4296-917d-767756f8cdf3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:18.205000 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e04b5d4a-6568-4296-917d-767756f8cdf3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:18.205796 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e04b5d4a-6568-4296-917d-767756f8cdf3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:18.206236 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e04b5d4a-6568-4296-917d-767756f8cdf3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:18.457226 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e04b5d4a-6568-4296-917d-767756f8cdf3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:18.471169 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e04b5d4a-6568-4296-917d-767756f8cdf3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1678 microversion: 2.1 time: 0.276981 Feb 28 10:35:18.486774 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 294/552] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:18 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1678 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:19.489699 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b2c2cb2b-2357-4eb1-a603-3414a3054104 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:19.490382 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b2c2cb2b-2357-4eb1-a603-3414a3054104 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:19.497658 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b2c2cb2b-2357-4eb1-a603-3414a3054104 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:19.498304 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b2c2cb2b-2357-4eb1-a603-3414a3054104 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:19.499279 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b2c2cb2b-2357-4eb1-a603-3414a3054104 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:19.500183 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b2c2cb2b-2357-4eb1-a603-3414a3054104 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:20.001745 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b2c2cb2b-2357-4eb1-a603-3414a3054104 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:20.017329 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b2c2cb2b-2357-4eb1-a603-3414a3054104 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1678 microversion: 2.1 time: 0.531915 Feb 28 10:35:20.017923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 259/553] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:19 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1678 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:20.501869 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-5d23abe2-5def-4059-ae3a-7470337bb5d0 req-d0556fbd-f286-495f-a370-17dceb892037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6a8a33-e76e-450b-a94a-a0852fc6472c", "tag": "c294705d-35da-4f5d-8e43-0a930f3b63a3"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:20.511473 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-5d23abe2-5def-4059-ae3a-7470337bb5d0 req-d0556fbd-f286-495f-a370-17dceb892037 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:20.513030 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-5d23abe2-5def-4059-ae3a-7470337bb5d0 req-d0556fbd-f286-495f-a370-17dceb892037 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:20.529783 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-5d23abe2-5def-4059-ae3a-7470337bb5d0 req-d0556fbd-f286-495f-a370-17dceb892037 service nova] Creating event network-changed:c294705d-35da-4f5d-8e43-0a930f3b63a3 for instance 6f6a8a33-e76e-450b-a94a-a0852fc6472c on hv-cinder-maste Feb 28 10:35:20.542525 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-5d23abe2-5def-4059-ae3a-7470337bb5d0 req-d0556fbd-f286-495f-a370-17dceb892037 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044493 Feb 28 10:35:20.543776 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 295/554] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:21.035808 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c9b999a2-212f-4370-b010-284e7326f0b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:21.037201 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c9b999a2-212f-4370-b010-284e7326f0b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:21.045053 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c9b999a2-212f-4370-b010-284e7326f0b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:21.045784 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c9b999a2-212f-4370-b010-284e7326f0b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:21.046839 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c9b999a2-212f-4370-b010-284e7326f0b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:21.047490 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c9b999a2-212f-4370-b010-284e7326f0b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:21.234445 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c9b999a2-212f-4370-b010-284e7326f0b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:21.242253 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c9b999a2-212f-4370-b010-284e7326f0b1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1678 microversion: 2.1 time: 0.210602 Feb 28 10:35:21.242862 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 260/555] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:21 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:22.260500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8682c0f3-fa0b-41e0-881e-ff5f6d9b3765 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:22.261285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8682c0f3-fa0b-41e0-881e-ff5f6d9b3765 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:22.271791 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8682c0f3-fa0b-41e0-881e-ff5f6d9b3765 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:22.271791 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8682c0f3-fa0b-41e0-881e-ff5f6d9b3765 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:22.272049 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8682c0f3-fa0b-41e0-881e-ff5f6d9b3765 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:22.272472 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8682c0f3-fa0b-41e0-881e-ff5f6d9b3765 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:22.415736 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8682c0f3-fa0b-41e0-881e-ff5f6d9b3765 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:22.424488 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8682c0f3-fa0b-41e0-881e-ff5f6d9b3765 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1678 microversion: 2.1 time: 0.168099 Feb 28 10:35:22.425138 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 296/556] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:22 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:23.443456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c70b98ef-66ae-4e8d-ab8e-f399b932c1ba tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:23.447475 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c70b98ef-66ae-4e8d-ab8e-f399b932c1ba tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:23.456090 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c70b98ef-66ae-4e8d-ab8e-f399b932c1ba tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:23.456679 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c70b98ef-66ae-4e8d-ab8e-f399b932c1ba tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:23.457583 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c70b98ef-66ae-4e8d-ab8e-f399b932c1ba tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:23.458235 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c70b98ef-66ae-4e8d-ab8e-f399b932c1ba tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:23.672013 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c70b98ef-66ae-4e8d-ab8e-f399b932c1ba tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:23.679393 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c70b98ef-66ae-4e8d-ab8e-f399b932c1ba tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1678 microversion: 2.1 time: 0.239705 Feb 28 10:35:23.679948 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 261/557] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:23 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:24.424433 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7c831226-ce75-433e-bbc9-96c8b4332369 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:24.425201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7c831226-ce75-433e-bbc9-96c8b4332369 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:24.432056 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7c831226-ce75-433e-bbc9-96c8b4332369 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:24.432621 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7c831226-ce75-433e-bbc9-96c8b4332369 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:24.433691 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7c831226-ce75-433e-bbc9-96c8b4332369 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:24.434239 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7c831226-ce75-433e-bbc9-96c8b4332369 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:24.580858 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7c831226-ce75-433e-bbc9-96c8b4332369 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:24.588747 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7c831226-ce75-433e-bbc9-96c8b4332369 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1592 microversion: 2.1 time: 0.168493 Feb 28 10:35:24.589311 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 297/558] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:24 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1592 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:24.697150 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-77350a18-0a25-49d8-8e56-8c6ec53f02c2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:24.697756 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-77350a18-0a25-49d8-8e56-8c6ec53f02c2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:24.706007 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-77350a18-0a25-49d8-8e56-8c6ec53f02c2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:24.706934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-77350a18-0a25-49d8-8e56-8c6ec53f02c2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:24.708036 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-77350a18-0a25-49d8-8e56-8c6ec53f02c2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:24.708705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-77350a18-0a25-49d8-8e56-8c6ec53f02c2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:24.853773 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-77350a18-0a25-49d8-8e56-8c6ec53f02c2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:24.862690 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-77350a18-0a25-49d8-8e56-8c6ec53f02c2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1678 microversion: 2.1 time: 0.169217 Feb 28 10:35:24.863258 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 262/559] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:24 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:25.881008 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-66b7df61-9f14-42b0-bd6c-0527662b764d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:25.881646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-66b7df61-9f14-42b0-bd6c-0527662b764d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:25.888603 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-66b7df61-9f14-42b0-bd6c-0527662b764d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:25.889346 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-66b7df61-9f14-42b0-bd6c-0527662b764d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:25.890090 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-66b7df61-9f14-42b0-bd6c-0527662b764d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:25.890535 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-66b7df61-9f14-42b0-bd6c-0527662b764d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:26.026419 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-66b7df61-9f14-42b0-bd6c-0527662b764d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:26.033880 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-66b7df61-9f14-42b0-bd6c-0527662b764d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1678 microversion: 2.1 time: 0.156953 Feb 28 10:35:26.034443 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 298/560] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:25 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:26.424936 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-0693c80e-3615-484b-9169-e3443fbee261 req-b488af1d-e095-4fec-b974-e06ec9bbc940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1e2144-30f4-491e-a85f-59b429f9879b", "tag": "4b9ee076-d1ee-4590-80a3-6e8e06acb5ce"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:26.434884 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-0693c80e-3615-484b-9169-e3443fbee261 req-b488af1d-e095-4fec-b974-e06ec9bbc940 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:26.436299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-0693c80e-3615-484b-9169-e3443fbee261 req-b488af1d-e095-4fec-b974-e06ec9bbc940 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:26.450415 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-0693c80e-3615-484b-9169-e3443fbee261 req-b488af1d-e095-4fec-b974-e06ec9bbc940 service nova] Creating event network-changed:4b9ee076-d1ee-4590-80a3-6e8e06acb5ce for instance ba1e2144-30f4-491e-a85f-59b429f9879b on hv-cinder-maste Feb 28 10:35:26.455375 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-0693c80e-3615-484b-9169-e3443fbee261 req-b488af1d-e095-4fec-b974-e06ec9bbc940 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034613 Feb 28 10:35:26.456677 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 263/561] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:27.053865 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a2803723-47b0-417b-a38b-cbad8d03d12c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:27.055719 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a2803723-47b0-417b-a38b-cbad8d03d12c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:27.062553 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a2803723-47b0-417b-a38b-cbad8d03d12c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:27.063183 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a2803723-47b0-417b-a38b-cbad8d03d12c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:27.064018 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a2803723-47b0-417b-a38b-cbad8d03d12c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:27.064456 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a2803723-47b0-417b-a38b-cbad8d03d12c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:27.254367 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a2803723-47b0-417b-a38b-cbad8d03d12c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:27.262395 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a2803723-47b0-417b-a38b-cbad8d03d12c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1678 microversion: 2.1 time: 0.213689 Feb 28 10:35:27.263013 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 299/562] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:27 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:27.602539 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e9367d4c-b4c8-48a4-a59b-a9aed16af432 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1037844897"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:27.604010 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e9367d4c-b4c8-48a4-a59b-a9aed16af432 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:27.611449 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e9367d4c-b4c8-48a4-a59b-a9aed16af432 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:27.612052 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e9367d4c-b4c8-48a4-a59b-a9aed16af432 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:27.612872 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e9367d4c-b4c8-48a4-a59b-a9aed16af432 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:27.613548 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e9367d4c-b4c8-48a4-a59b-a9aed16af432 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:27.751941 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.network.security_group_api [None req-e9367d4c-b4c8-48a4-a59b-a9aed16af432 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Adding security group bbfa3633-89c5-455a-832d-166fe5a33587 to port 4b9ee076-d1ee-4590-80a3-6e8e06acb5ce Feb 28 10:35:28.143608 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e9367d4c-b4c8-48a4-a59b-a9aed16af432 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "POST /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/action" status: 202 len: 0 microversion: 2.1 time: 0.545521 Feb 28 10:35:28.144790 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 264/563] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:35:27 2022] POST /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:35:28.154734 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-cbd784a2-6f10-41aa-8503-417d0c70d837 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:28.155977 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-cbd784a2-6f10-41aa-8503-417d0c70d837 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:28.159850 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-7d722b09-2c2d-4430-811d-1a1b5a25dd0d req-fd147713-a223-4031-bdae-57801d0af287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1e2144-30f4-491e-a85f-59b429f9879b", "tag": "4b9ee076-d1ee-4590-80a3-6e8e06acb5ce"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:28.165334 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbd784a2-6f10-41aa-8503-417d0c70d837 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:28.165816 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbd784a2-6f10-41aa-8503-417d0c70d837 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:28.167131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbd784a2-6f10-41aa-8503-417d0c70d837 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:28.167784 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cbd784a2-6f10-41aa-8503-417d0c70d837 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:28.172130 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-7d722b09-2c2d-4430-811d-1a1b5a25dd0d req-fd147713-a223-4031-bdae-57801d0af287 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:28.172572 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-7d722b09-2c2d-4430-811d-1a1b5a25dd0d req-fd147713-a223-4031-bdae-57801d0af287 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:28.189193 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-7d722b09-2c2d-4430-811d-1a1b5a25dd0d req-fd147713-a223-4031-bdae-57801d0af287 service nova] Creating event network-changed:4b9ee076-d1ee-4590-80a3-6e8e06acb5ce for instance ba1e2144-30f4-491e-a85f-59b429f9879b on hv-cinder-maste Feb 28 10:35:28.202520 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-7d722b09-2c2d-4430-811d-1a1b5a25dd0d req-fd147713-a223-4031-bdae-57801d0af287 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046577 Feb 28 10:35:28.207099 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 265/564] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:35:28.280890 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-1f11f911-9b9e-43c3-9215-d91d72d343bf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:28.281606 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-1f11f911-9b9e-43c3-9215-d91d72d343bf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:28.308469 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1f11f911-9b9e-43c3-9215-d91d72d343bf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:28.309685 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1f11f911-9b9e-43c3-9215-d91d72d343bf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:28.316473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1f11f911-9b9e-43c3-9215-d91d72d343bf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:28.316967 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1f11f911-9b9e-43c3-9215-d91d72d343bf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:28.514836 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-cbd784a2-6f10-41aa-8503-417d0c70d837 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:28.532315 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-cbd784a2-6f10-41aa-8503-417d0c70d837 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1758 microversion: 2.1 time: 0.382135 Feb 28 10:35:28.536818 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 300/565] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:28 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1758 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:28.613269 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-1f11f911-9b9e-43c3-9215-d91d72d343bf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:28.623976 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-1f11f911-9b9e-43c3-9215-d91d72d343bf tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1655 microversion: 2.1 time: 0.348434 Feb 28 10:35:28.625324 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 266/566] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:28 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1655 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:28.643064 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-44424666-eed6-49e8-93a9-c6191f05d81b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:35:28.648921 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-44424666-eed6-49e8-93a9-c6191f05d81b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:28.649694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-44424666-eed6-49e8-93a9-c6191f05d81b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:28.676647 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-44424666-eed6-49e8-93a9-c6191f05d81b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Going to try to start instance {{(pid=123152) start /opt/stack/nova/nova/compute/api.py:2730}} Feb 28 10:35:28.730139 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-44424666-eed6-49e8-93a9-c6191f05d81b tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/action" status: 202 len: 0 microversion: 2.1 time: 0.092973 Feb 28 10:35:28.732475 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 301/567] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:35:28 2022] POST /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 28 10:35:28.742799 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4d94a4cb-8edb-4b4d-bff9-d6aa62044d18 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:28.743800 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4d94a4cb-8edb-4b4d-bff9-d6aa62044d18 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:28.752386 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4d94a4cb-8edb-4b4d-bff9-d6aa62044d18 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:28.753081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4d94a4cb-8edb-4b4d-bff9-d6aa62044d18 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:28.754265 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4d94a4cb-8edb-4b4d-bff9-d6aa62044d18 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:28.754709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4d94a4cb-8edb-4b4d-bff9-d6aa62044d18 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:28.979612 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4d94a4cb-8edb-4b4d-bff9-d6aa62044d18 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:28.990372 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4d94a4cb-8edb-4b4d-bff9-d6aa62044d18 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1664 microversion: 2.1 time: 0.253329 Feb 28 10:35:28.993059 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 267/568] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:28 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1664 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:35:30.010062 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4b488901-a758-4a6a-99fd-af389a80521a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:30.010824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4b488901-a758-4a6a-99fd-af389a80521a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:30.016835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4b488901-a758-4a6a-99fd-af389a80521a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:30.017293 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4b488901-a758-4a6a-99fd-af389a80521a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:30.018086 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4b488901-a758-4a6a-99fd-af389a80521a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:30.018525 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4b488901-a758-4a6a-99fd-af389a80521a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:30.170852 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4b488901-a758-4a6a-99fd-af389a80521a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:30.178831 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4b488901-a758-4a6a-99fd-af389a80521a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1664 microversion: 2.1 time: 0.173283 Feb 28 10:35:30.179720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 302/569] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:30 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:35:31.198771 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b2d968d8-e2af-4eaf-9e56-9562bc700c4a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:35:31.199539 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b2d968d8-e2af-4eaf-9e56-9562bc700c4a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:35:31.206381 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b2d968d8-e2af-4eaf-9e56-9562bc700c4a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:31.206799 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b2d968d8-e2af-4eaf-9e56-9562bc700c4a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:31.207572 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b2d968d8-e2af-4eaf-9e56-9562bc700c4a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:35:31.208002 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b2d968d8-e2af-4eaf-9e56-9562bc700c4a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:35:31.349307 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b2d968d8-e2af-4eaf-9e56-9562bc700c4a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:35:31.357752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b2d968d8-e2af-4eaf-9e56-9562bc700c4a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1668 microversion: 2.1 time: 0.162846 Feb 28 10:35:31.358337 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 268/570] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:35:31 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:01.462865 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-67ee3728-8951-46e3-9970-2ad33149a73f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:01.463455 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-67ee3728-8951-46e3-9970-2ad33149a73f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:01.470108 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-67ee3728-8951-46e3-9970-2ad33149a73f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:01.470554 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-67ee3728-8951-46e3-9970-2ad33149a73f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:01.471358 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-67ee3728-8951-46e3-9970-2ad33149a73f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:01.471793 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-67ee3728-8951-46e3-9970-2ad33149a73f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:01.499648 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-67ee3728-8951-46e3-9970-2ad33149a73f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments/6dfbbc83-56bf-4476-b780-043edefe4ceb" status: 200 len: 194 microversion: 2.20 time: 0.040995 Feb 28 10:36:01.500215 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 303/571] 10.222.0.21 () {60 vars in 1453 bytes} [Mon Feb 28 10:36:01 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments/6dfbbc83-56bf-4476-b780-043edefe4ceb => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:36:01.564176 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0c2477d5-e3d9-4e47-b7ed-f7efeadb37a3 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:01.564725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0c2477d5-e3d9-4e47-b7ed-f7efeadb37a3 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:01.570788 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0c2477d5-e3d9-4e47-b7ed-f7efeadb37a3 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:01.571237 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0c2477d5-e3d9-4e47-b7ed-f7efeadb37a3 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:01.572017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0c2477d5-e3d9-4e47-b7ed-f7efeadb37a3 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:01.572460 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0c2477d5-e3d9-4e47-b7ed-f7efeadb37a3 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:01.651145 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-0c2477d5-e3d9-4e47-b7ed-f7efeadb37a3 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lazy-loading 'services' on Instance uuid 1ead279e-e2e9-4312-a47a-fbec064ce99b {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:36:01.725014 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0c2477d5-e3d9-4e47-b7ed-f7efeadb37a3 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments/6dfbbc83-56bf-4476-b780-043edefe4ceb" status: 202 len: 0 microversion: 2.20 time: 0.167248 Feb 28 10:36:01.725541 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 269/572] 10.222.0.21 () {60 vars in 1456 bytes} [Mon Feb 28 10:36:01 2022] DELETE /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments/6dfbbc83-56bf-4476-b780-043edefe4ceb => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:36:01.734267 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ff50a178-9207-4b36-b7d7-abadc7c408bf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:01.735315 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ff50a178-9207-4b36-b7d7-abadc7c408bf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:01.744741 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ff50a178-9207-4b36-b7d7-abadc7c408bf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:01.745186 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ff50a178-9207-4b36-b7d7-abadc7c408bf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:01.746116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ff50a178-9207-4b36-b7d7-abadc7c408bf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:01.747223 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ff50a178-9207-4b36-b7d7-abadc7c408bf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:01.781926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ff50a178-9207-4b36-b7d7-abadc7c408bf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051925 Feb 28 10:36:01.784465 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 304/573] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Feb 28 10:36:01 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 10:36:02.794427 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-14623fda-6c34-4f77-a56b-2503ab76e35c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:02.795527 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-14623fda-6c34-4f77-a56b-2503ab76e35c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:02.802135 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14623fda-6c34-4f77-a56b-2503ab76e35c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:02.802584 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14623fda-6c34-4f77-a56b-2503ab76e35c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:02.803386 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14623fda-6c34-4f77-a56b-2503ab76e35c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:02.803826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14623fda-6c34-4f77-a56b-2503ab76e35c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:02.832668 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-14623fda-6c34-4f77-a56b-2503ab76e35c tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042984 Feb 28 10:36:02.833225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 270/574] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Feb 28 10:36:02 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:36:02.891242 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-cdb8cb96-2138-47c2-bc2a-d64bdc274e25 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:02.891740 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-cdb8cb96-2138-47c2-bc2a-d64bdc274e25 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:02.897882 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cdb8cb96-2138-47c2-bc2a-d64bdc274e25 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:02.898321 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cdb8cb96-2138-47c2-bc2a-d64bdc274e25 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:02.899121 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cdb8cb96-2138-47c2-bc2a-d64bdc274e25 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:02.899548 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-cdb8cb96-2138-47c2-bc2a-d64bdc274e25 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:02.923984 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-cdb8cb96-2138-47c2-bc2a-d64bdc274e25 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:36:02.998224 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-cdb8cb96-2138-47c2-bc2a-d64bdc274e25 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 204 len: 0 microversion: 2.20 time: 0.111672 Feb 28 10:36:02.999083 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 305/575] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Feb 28 10:36:02 2022] DELETE /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 28 10:36:03.007747 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:03.008359 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:03.014462 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:03.014941 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:03.015721 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:03.016158 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:03.158197 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:03.165914 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:03.167478 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:03.169302 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-002fd27a-fc40-41e6-a44a-cf4bc6f9241e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.165895 Feb 28 10:36:03.169845 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 271/576] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:03 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:04.188133 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:04.188829 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:04.195062 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:04.195506 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:04.196283 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:04.196733 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:04.338502 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:04.347871 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:04.349433 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:04.350587 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0ec669c8-db22-48f2-9d35-95fdc369b11b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.166688 Feb 28 10:36:04.351157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 306/577] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:04 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:05.372366 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:05.372988 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:05.379317 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:05.379771 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:05.380558 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:05.381087 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:05.984759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:05.993044 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:05.994843 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:05.996922 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3b060fc6-1cf6-4509-a4cd-3e252c926e0d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1723 microversion: 2.20 time: 0.630916 Feb 28 10:36:05.998934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 272/578] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:05 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1723 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:06.458897 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-def72b67-57c2-4046-9cf4-a0d99abd2e2c req-945aa814-5249-4a0a-b318-5efc8a3b3d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ead279e-e2e9-4312-a47a-fbec064ce99b", "name": "network-vif-deleted", "tag": "76aed61f-8cd7-4455-a163-d78d7f320a35"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:06.470863 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-def72b67-57c2-4046-9cf4-a0d99abd2e2c req-945aa814-5249-4a0a-b318-5efc8a3b3d82 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:06.471493 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-def72b67-57c2-4046-9cf4-a0d99abd2e2c req-945aa814-5249-4a0a-b318-5efc8a3b3d82 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:06.486402 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-def72b67-57c2-4046-9cf4-a0d99abd2e2c req-945aa814-5249-4a0a-b318-5efc8a3b3d82 service nova] Creating event network-vif-deleted:76aed61f-8cd7-4455-a163-d78d7f320a35 for instance 1ead279e-e2e9-4312-a47a-fbec064ce99b on hv-cinder-maste Feb 28 10:36:06.491570 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-def72b67-57c2-4046-9cf4-a0d99abd2e2c req-945aa814-5249-4a0a-b318-5efc8a3b3d82 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036501 Feb 28 10:36:06.492456 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 307/579] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:07.016136 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:07.016753 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:07.023840 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:07.024646 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:07.025705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:07.026334 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:07.061143 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:07.061843 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:07.062487 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lazy-loading 'fault' on Instance uuid 1ead279e-e2e9-4312-a47a-fbec064ce99b {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:36:07.132630 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:07.141835 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:07.143393 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:07.146100 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-804505c9-a00b-4804-afc8-7f65838ab591 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 200 len: 1371 microversion: 2.20 time: 0.134913 Feb 28 10:36:07.147473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 273/580] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:07 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 1371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:08.166038 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-96d34d0c-d24e-42d5-9171-446f4341fdae tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:08.166744 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-96d34d0c-d24e-42d5-9171-446f4341fdae tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:08.174228 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-96d34d0c-d24e-42d5-9171-446f4341fdae tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:08.174900 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-96d34d0c-d24e-42d5-9171-446f4341fdae tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:08.175682 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-96d34d0c-d24e-42d5-9171-446f4341fdae tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:08.176258 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-96d34d0c-d24e-42d5-9171-446f4341fdae tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:08.189846 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-96d34d0c-d24e-42d5-9171-446f4341fdae tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] HTTP exception thrown: Instance 1ead279e-e2e9-4312-a47a-fbec064ce99b could not be found. Feb 28 10:36:08.190437 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-96d34d0c-d24e-42d5-9171-446f4341fdae tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Returning 404 to user: Instance 1ead279e-e2e9-4312-a47a-fbec064ce99b could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:36:08.191284 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-96d34d0c-d24e-42d5-9171-446f4341fdae tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 404 len: 111 microversion: 2.20 time: 0.029521 Feb 28 10:36:08.191816 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 308/581] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:08 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 10:36:08.200539 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-464b3bda-174a-4f54-8d5d-02e457c3a5f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '.version_select at 0x7f1c5837faf0>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:08.223601 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-464b3bda-174a-4f54-8d5d-02e457c3a5f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296032570" status: 204 len: 0 microversion: 2.20 time: 0.026890 Feb 28 10:36:08.227846 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 274/582] 10.222.0.21 () {60 vars in 1261 bytes} [Mon Feb 28 10:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296032570 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 28 10:36:09.027629 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-113b838c-da4d-4a51-b6b1-e6ff14a55346 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'create', calling method: .version_select at 0x7f1c582c85e0>, body: {"keypair": {"name": "tempest-keypair-1386347708"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:09.041244 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-113b838c-da4d-4a51-b6b1-e6ff14a55346 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for project 003233ff59254fa88847f9adc1437df3. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:36:09.045988 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-113b838c-da4d-4a51-b6b1-e6ff14a55346 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for user da9524bba20140f694ac7cd6e8f37038 and project 003233ff59254fa88847f9adc1437df3. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:36:09.274584 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-14ede84a-2883-4b88-a3a9-0a238a729878 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:09.276352 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-14ede84a-2883-4b88-a3a9-0a238a729878 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:09.285685 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14ede84a-2883-4b88-a3a9-0a238a729878 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:09.286589 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14ede84a-2883-4b88-a3a9-0a238a729878 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:09.287670 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14ede84a-2883-4b88-a3a9-0a238a729878 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:09.288331 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14ede84a-2883-4b88-a3a9-0a238a729878 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:09.357463 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-113b838c-da4d-4a51-b6b1-e6ff14a55346 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for project 003233ff59254fa88847f9adc1437df3. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:36:09.367857 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-113b838c-da4d-4a51-b6b1-e6ff14a55346 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for user da9524bba20140f694ac7cd6e8f37038 and project 003233ff59254fa88847f9adc1437df3. Resources: {'key_pairs'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:36:09.398430 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-113b838c-da4d-4a51-b6b1-e6ff14a55346 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.375087 Feb 28 10:36:09.400629 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 309/583] 10.222.0.21 () {62 vars in 1198 bytes} [Mon Feb 28 10:36:09 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 378 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 28 10:36:09.455253 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-14ede84a-2883-4b88-a3a9-0a238a729878 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "POST /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/action" status: 202 len: 0 microversion: 2.1 time: 0.185546 Feb 28 10:36:09.456207 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 275/584] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:36:09 2022] POST /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 28 10:36:09.468273 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-23eff195-1427-43c1-95f3-8a37e9fc2249 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:09.469108 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-23eff195-1427-43c1-95f3-8a37e9fc2249 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:09.490859 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-23eff195-1427-43c1-95f3-8a37e9fc2249 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:09.494159 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-23eff195-1427-43c1-95f3-8a37e9fc2249 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:09.497135 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-23eff195-1427-43c1-95f3-8a37e9fc2249 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:09.499093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-23eff195-1427-43c1-95f3-8a37e9fc2249 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:09.842503 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-23eff195-1427-43c1-95f3-8a37e9fc2249 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:09.862213 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-23eff195-1427-43c1-95f3-8a37e9fc2249 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1750 microversion: 2.1 time: 0.401804 Feb 28 10:36:09.862820 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 310/585] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:09 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1750 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:10.881529 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c0ecddb2-0913-4302-bb2e-70d37adc2070 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:10.882374 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c0ecddb2-0913-4302-bb2e-70d37adc2070 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:10.888837 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0ecddb2-0913-4302-bb2e-70d37adc2070 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:10.889334 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0ecddb2-0913-4302-bb2e-70d37adc2070 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:10.890329 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0ecddb2-0913-4302-bb2e-70d37adc2070 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:10.890799 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0ecddb2-0913-4302-bb2e-70d37adc2070 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:11.048557 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c0ecddb2-0913-4302-bb2e-70d37adc2070 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:11.057064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c0ecddb2-0913-4302-bb2e-70d37adc2070 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.180760 Feb 28 10:36:11.057809 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 276/586] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:10 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:11.154681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-951350460", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3e00203-bdaa-4ba7-b433-d6d5ad5222b3"}], "security_groups": [{"name": "tempest-securitygroup--1820770619"}], "key_name": "tempest-keypair-1386347708", "user_data": "}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:11.254357 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.network.neutron [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] validate_networks() for [('a3e00203-bdaa-4ba7-b433-d6d5ad5222b3', None, None, None, None, None)] {{(pid=123152) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:36:11.616787 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Flavor limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:36:11.617186 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Image limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:36:11.617654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Flavor pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:36:11.618060 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Image pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:36:11.618465 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:36:11.627700 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:11.628148 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:11.628958 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:11.629394 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:11.645573 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for project 003233ff59254fa88847f9adc1437df3. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:36:11.649509 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Getting quotas for user da9524bba20140f694ac7cd6e8f37038 and project 003233ff59254fa88847f9adc1437df3. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:36:11.664787 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Going to run 1 instances... {{(pid=123152) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:36:11.667061 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:36:11.713177 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a1aae736-97b3-433a-8ded-7cc0cb12cb2b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.563667 Feb 28 10:36:11.713741 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 311/587] 10.222.0.21 () {62 vars in 1187 bytes} [Mon Feb 28 10:36:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 28 10:36:11.724589 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-fc1f08aa-5528-48bd-afaa-93782b29d12f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:11.725470 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-fc1f08aa-5528-48bd-afaa-93782b29d12f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:11.780439 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fc1f08aa-5528-48bd-afaa-93782b29d12f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:11.789195 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fc1f08aa-5528-48bd-afaa-93782b29d12f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:11.791020 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fc1f08aa-5528-48bd-afaa-93782b29d12f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:11.792129 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-fc1f08aa-5528-48bd-afaa-93782b29d12f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1281 microversion: 2.20 time: 0.071435 Feb 28 10:36:11.792867 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 277/588] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:11 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:12.076811 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ba0695c9-df92-4342-89df-a16c03563661 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:12.077485 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ba0695c9-df92-4342-89df-a16c03563661 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:12.084108 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ba0695c9-df92-4342-89df-a16c03563661 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:12.084670 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ba0695c9-df92-4342-89df-a16c03563661 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:12.085585 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ba0695c9-df92-4342-89df-a16c03563661 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:12.086188 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ba0695c9-df92-4342-89df-a16c03563661 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:12.242486 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ba0695c9-df92-4342-89df-a16c03563661 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:12.251095 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ba0695c9-df92-4342-89df-a16c03563661 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.179441 Feb 28 10:36:12.251645 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 312/589] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:12 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:36:12.810102 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:12.810755 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:12.817516 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:12.817967 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:12.818795 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:12.819229 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:12.903652 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:12.911997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:12.913555 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:12.914698 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b00c4c13-5791-4fbd-8835-ab6eab68eb07 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1341 microversion: 2.20 time: 0.108511 Feb 28 10:36:12.915597 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 278/590] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:12 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1341 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:13.270244 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-05899b55-6692-47e8-82d1-6b480f86cfa3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:13.270854 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-05899b55-6692-47e8-82d1-6b480f86cfa3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:13.278187 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-05899b55-6692-47e8-82d1-6b480f86cfa3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:13.279302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-05899b55-6692-47e8-82d1-6b480f86cfa3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:13.280345 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-05899b55-6692-47e8-82d1-6b480f86cfa3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:13.282131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-05899b55-6692-47e8-82d1-6b480f86cfa3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:13.535274 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-05899b55-6692-47e8-82d1-6b480f86cfa3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:13.543725 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-05899b55-6692-47e8-82d1-6b480f86cfa3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.278353 Feb 28 10:36:13.544414 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 313/591] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:13 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:13.932371 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:13.932986 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:13.939550 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:13.939940 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:13.940722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:13.941160 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:14.003405 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-73faed7a-9871-4afe-921c-7350627717dc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:14.004478 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-73faed7a-9871-4afe-921c-7350627717dc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:14.010294 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-73faed7a-9871-4afe-921c-7350627717dc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:14.010866 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-73faed7a-9871-4afe-921c-7350627717dc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:14.012269 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-73faed7a-9871-4afe-921c-7350627717dc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:14.012785 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-73faed7a-9871-4afe-921c-7350627717dc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:14.041013 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-73faed7a-9871-4afe-921c-7350627717dc tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041527 Feb 28 10:36:14.041552 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 314/592] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:36:13 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 10:36:14.100705 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3558d24b-e5bb-42c4-a1c2-5706d01124a4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:14.101212 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3558d24b-e5bb-42c4-a1c2-5706d01124a4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:14.107153 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3558d24b-e5bb-42c4-a1c2-5706d01124a4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:14.107605 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3558d24b-e5bb-42c4-a1c2-5706d01124a4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:14.108391 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3558d24b-e5bb-42c4-a1c2-5706d01124a4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:14.108827 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3558d24b-e5bb-42c4-a1c2-5706d01124a4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:14.135434 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3558d24b-e5bb-42c4-a1c2-5706d01124a4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:36:14.224693 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3558d24b-e5bb-42c4-a1c2-5706d01124a4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "DELETE /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 204 len: 0 microversion: 2.1 time: 0.126870 Feb 28 10:36:14.225636 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 315/593] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:36:14 2022] DELETE /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 10:36:14.229158 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:14.236884 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f6216f35-3a62-4d87-9390-cd62c4638bac tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:14.237840 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f6216f35-3a62-4d87-9390-cd62c4638bac tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:14.240492 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:14.243372 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:14.244524 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8adb7971-fabb-4219-8d6a-42e0cbad87c9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1407 microversion: 2.20 time: 0.316149 Feb 28 10:36:14.244860 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f6216f35-3a62-4d87-9390-cd62c4638bac tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:14.245623 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f6216f35-3a62-4d87-9390-cd62c4638bac tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:14.245803 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 279/594] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:13 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:14.247380 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f6216f35-3a62-4d87-9390-cd62c4638bac tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:14.247980 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f6216f35-3a62-4d87-9390-cd62c4638bac tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:14.482880 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-025a4c55-ff9d-46ba-b653-a95e5dc376c7 req-285eaf43-b1ef-422f-8f69-e84549413016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d16ba15-2ef6-4ce9-a9cd-d5e14657271a", "tag": "c091db1b-3683-4633-8290-5a1701243cc7"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:14.492591 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f6216f35-3a62-4d87-9390-cd62c4638bac tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:14.502847 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-025a4c55-ff9d-46ba-b653-a95e5dc376c7 req-285eaf43-b1ef-422f-8f69-e84549413016 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:14.504172 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f6216f35-3a62-4d87-9390-cd62c4638bac tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1674 microversion: 2.1 time: 0.272713 Feb 28 10:36:14.504671 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-025a4c55-ff9d-46ba-b653-a95e5dc376c7 req-285eaf43-b1ef-422f-8f69-e84549413016 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:14.508412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 316/595] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:14 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:14.532630 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-025a4c55-ff9d-46ba-b653-a95e5dc376c7 req-285eaf43-b1ef-422f-8f69-e84549413016 service nova] Creating event network-changed:c091db1b-3683-4633-8290-5a1701243cc7 for instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a on hv-cinder-maste Feb 28 10:36:14.542982 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-025a4c55-ff9d-46ba-b653-a95e5dc376c7 req-285eaf43-b1ef-422f-8f69-e84549413016 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071361 Feb 28 10:36:14.543717 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 280/596] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:14.563782 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7c56bef1-a7cd-45a8-a9b9-4698b83f61c2 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:14.564508 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7c56bef1-a7cd-45a8-a9b9-4698b83f61c2 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:14.582304 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7c56bef1-a7cd-45a8-a9b9-4698b83f61c2 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:14.583006 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7c56bef1-a7cd-45a8-a9b9-4698b83f61c2 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:14.583967 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7c56bef1-a7cd-45a8-a9b9-4698b83f61c2 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:14.586100 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7c56bef1-a7cd-45a8-a9b9-4698b83f61c2 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:15.097776 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7c56bef1-a7cd-45a8-a9b9-4698b83f61c2 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:15.106257 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7c56bef1-a7cd-45a8-a9b9-4698b83f61c2 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.546390 Feb 28 10:36:15.106954 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 317/597] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:14 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:15.264244 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:15.264856 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:15.271551 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:15.272004 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:15.272801 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:15.273237 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:15.420257 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:15.428566 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:15.430086 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:15.431220 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-16e4b2f7-2006-4da4-9c7c-f63c24449773 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1407 microversion: 2.20 time: 0.171626 Feb 28 10:36:15.431961 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 281/598] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:15 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:15.525381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9a83cf92-5687-46b9-9cd4-851a727875c3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:15.525939 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9a83cf92-5687-46b9-9cd4-851a727875c3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:15.533225 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9a83cf92-5687-46b9-9cd4-851a727875c3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:15.533671 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9a83cf92-5687-46b9-9cd4-851a727875c3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:15.534456 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9a83cf92-5687-46b9-9cd4-851a727875c3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:15.535086 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9a83cf92-5687-46b9-9cd4-851a727875c3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:15.765942 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9a83cf92-5687-46b9-9cd4-851a727875c3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:15.773948 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9a83cf92-5687-46b9-9cd4-851a727875c3 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1674 microversion: 2.1 time: 0.252493 Feb 28 10:36:15.774713 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 318/599] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:15 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1674 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:16.123396 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0107eebf-d924-4114-99f3-0c7c69bd63e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:16.124044 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0107eebf-d924-4114-99f3-0c7c69bd63e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:16.130217 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0107eebf-d924-4114-99f3-0c7c69bd63e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:16.130748 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0107eebf-d924-4114-99f3-0c7c69bd63e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:16.131571 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0107eebf-d924-4114-99f3-0c7c69bd63e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:16.132013 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0107eebf-d924-4114-99f3-0c7c69bd63e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:16.278769 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0107eebf-d924-4114-99f3-0c7c69bd63e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:16.286509 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0107eebf-d924-4114-99f3-0c7c69bd63e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.167681 Feb 28 10:36:16.287114 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 282/600] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:16 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:16.448988 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:16.449741 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:16.455714 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:16.456166 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:16.456949 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:16.457386 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:16.597341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:16.606496 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:16.608155 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:16.609574 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-02cecb8a-6b99-44f7-95ef-25269e32388a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1407 microversion: 2.20 time: 0.164622 Feb 28 10:36:16.610142 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 319/601] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:16 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:36:16.791378 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ff1e7670-646b-4eae-b0d2-83efc1dd5f25 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:16.792050 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ff1e7670-646b-4eae-b0d2-83efc1dd5f25 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:16.798385 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ff1e7670-646b-4eae-b0d2-83efc1dd5f25 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:16.798874 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ff1e7670-646b-4eae-b0d2-83efc1dd5f25 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:16.799655 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ff1e7670-646b-4eae-b0d2-83efc1dd5f25 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:16.800119 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ff1e7670-646b-4eae-b0d2-83efc1dd5f25 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:17.045790 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ff1e7670-646b-4eae-b0d2-83efc1dd5f25 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:17.055558 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ff1e7670-646b-4eae-b0d2-83efc1dd5f25 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1674 microversion: 2.1 time: 0.267974 Feb 28 10:36:17.057330 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 283/602] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:16 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1674 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:17.304197 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5c489e1f-0786-4bfa-a77c-502179dd83e3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:17.304920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5c489e1f-0786-4bfa-a77c-502179dd83e3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:17.311159 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5c489e1f-0786-4bfa-a77c-502179dd83e3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:17.311616 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5c489e1f-0786-4bfa-a77c-502179dd83e3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:17.312413 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5c489e1f-0786-4bfa-a77c-502179dd83e3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:17.312857 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5c489e1f-0786-4bfa-a77c-502179dd83e3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:17.534582 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5c489e1f-0786-4bfa-a77c-502179dd83e3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:17.542438 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5c489e1f-0786-4bfa-a77c-502179dd83e3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.242524 Feb 28 10:36:17.543134 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 320/603] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:17 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:17.628087 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:17.628701 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:17.635513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:17.635966 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:17.637439 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:17.637891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:17.865436 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:17.874086 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:17.875620 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:17.876876 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-63f0a51c-bfeb-4842-ae1d-0ab34ea6ce22 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1407 microversion: 2.20 time: 0.252830 Feb 28 10:36:17.887262 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 284/604] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:17 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:17.915974 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-a4004917-50c3-45ee-9b19-36ccd278f1b0 req-51456ef7-4b59-421c-b361-4d4a91a7f973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb676a4-94b3-4550-8eb3-b12a16f6f3ec", "name": "network-vif-deleted", "tag": "b1a42156-5d5f-4727-a2fd-ca0b2cece4af"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:17.929488 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-a4004917-50c3-45ee-9b19-36ccd278f1b0 req-51456ef7-4b59-421c-b361-4d4a91a7f973 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:17.929934 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-a4004917-50c3-45ee-9b19-36ccd278f1b0 req-51456ef7-4b59-421c-b361-4d4a91a7f973 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:17.953180 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-a4004917-50c3-45ee-9b19-36ccd278f1b0 req-51456ef7-4b59-421c-b361-4d4a91a7f973 service nova] Creating event network-vif-deleted:b1a42156-5d5f-4727-a2fd-ca0b2cece4af for instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec on hv-cinder-maste Feb 28 10:36:17.958076 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-a4004917-50c3-45ee-9b19-36ccd278f1b0 req-51456ef7-4b59-421c-b361-4d4a91a7f973 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045710 Feb 28 10:36:17.958702 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 321/605] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:18.077432 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:18.078849 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:18.085853 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:18.086743 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:18.088179 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:18.088678 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:18.120646 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:18.121774 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:18.122759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lazy-loading 'fault' on Instance uuid eeb676a4-94b3-4550-8eb3-b12a16f6f3ec {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:36:18.162415 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:18.169931 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c0688957-c68e-4154-8512-f486ed4cdad2 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 200 len: 1328 microversion: 2.1 time: 0.100099 Feb 28 10:36:18.170493 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 285/606] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:18 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:18.561623 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5d588074-de7f-4beb-a4b1-42e34a421552 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:18.562331 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5d588074-de7f-4beb-a4b1-42e34a421552 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:18.568493 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5d588074-de7f-4beb-a4b1-42e34a421552 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:18.568951 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5d588074-de7f-4beb-a4b1-42e34a421552 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:18.569783 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5d588074-de7f-4beb-a4b1-42e34a421552 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:18.570229 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5d588074-de7f-4beb-a4b1-42e34a421552 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:18.726694 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5d588074-de7f-4beb-a4b1-42e34a421552 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:18.737466 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5d588074-de7f-4beb-a4b1-42e34a421552 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.181292 Feb 28 10:36:18.738177 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 322/607] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:18 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:18.894707 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:18.895400 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:18.901554 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:18.902679 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:18.904088 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:18.904593 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:18.943255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-a9bb1d6c-6488-45e9-bdff-2b7177b5ef60 req-23f32061-3975-482d-890f-69585da1f9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d16ba15-2ef6-4ce9-a9cd-d5e14657271a", "name": "network-vif-plugged", "status": "completed", "tag": "c091db1b-3683-4633-8290-5a1701243cc7"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:18.963194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-a9bb1d6c-6488-45e9-bdff-2b7177b5ef60 req-23f32061-3975-482d-890f-69585da1f9ee service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:18.963983 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-a9bb1d6c-6488-45e9-bdff-2b7177b5ef60 req-23f32061-3975-482d-890f-69585da1f9ee service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:18.976841 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-a9bb1d6c-6488-45e9-bdff-2b7177b5ef60 req-23f32061-3975-482d-890f-69585da1f9ee service nova] Creating event network-vif-plugged:c091db1b-3683-4633-8290-5a1701243cc7 for instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a on hv-cinder-maste Feb 28 10:36:18.981902 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-a9bb1d6c-6488-45e9-bdff-2b7177b5ef60 req-23f32061-3975-482d-890f-69585da1f9ee service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042250 Feb 28 10:36:18.982828 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 323/608] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:36:19.077005 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:19.089188 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:19.092047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:19.093184 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9b21d34f-5baf-45b4-90ba-acbd8289893e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1407 microversion: 2.20 time: 0.202438 Feb 28 10:36:19.093759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 286/609] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:18 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:19.188680 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0968dc80-249b-4f74-a1f4-e641c9858f73 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:19.189148 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0968dc80-249b-4f74-a1f4-e641c9858f73 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:19.200222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0968dc80-249b-4f74-a1f4-e641c9858f73 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:19.201024 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0968dc80-249b-4f74-a1f4-e641c9858f73 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:19.201783 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0968dc80-249b-4f74-a1f4-e641c9858f73 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:19.202229 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0968dc80-249b-4f74-a1f4-e641c9858f73 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:19.219066 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-0968dc80-249b-4f74-a1f4-e641c9858f73 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] HTTP exception thrown: Instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec could not be found. Feb 28 10:36:19.219662 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0968dc80-249b-4f74-a1f4-e641c9858f73 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Returning 404 to user: Instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:36:19.220489 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0968dc80-249b-4f74-a1f4-e641c9858f73 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 404 len: 111 microversion: 2.1 time: 0.036586 Feb 28 10:36:19.224737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 324/610] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:19 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:36:19.230126 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-529fe208-9ab5-4059-9793-f9c6c4f00b49 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '.version_select at 0x7f1c58220040>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:19.248336 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-529fe208-9ab5-4059-9793-f9c6c4f00b49 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136948982" status: 202 len: 0 microversion: 2.1 time: 0.022449 Feb 28 10:36:19.249021 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 287/611] 10.222.0.21 () {58 vars in 1220 bytes} [Mon Feb 28 10:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136948982 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:36:19.755519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6e39ea22-0d9e-4822-bf18-1922b24920bf tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:19.756302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6e39ea22-0d9e-4822-bf18-1922b24920bf tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:19.766735 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e39ea22-0d9e-4822-bf18-1922b24920bf tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:19.767392 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e39ea22-0d9e-4822-bf18-1922b24920bf tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:19.768334 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e39ea22-0d9e-4822-bf18-1922b24920bf tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:19.768927 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e39ea22-0d9e-4822-bf18-1922b24920bf tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:19.962362 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-11919cd5-a843-4057-993e-3b06fdf9758d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'create', calling method: .version_select at 0x7f1c58190280>, body: {"keypair": {"name": "tempest-keypair-1505073024"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:19.977955 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-11919cd5-a843-4057-993e-3b06fdf9758d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:36:19.982581 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-11919cd5-a843-4057-993e-3b06fdf9758d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for user 9f32c16ee62d441d9e5fde2b1ce0afaf and project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:36:20.002977 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6e39ea22-0d9e-4822-bf18-1922b24920bf tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:20.010770 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6e39ea22-0d9e-4822-bf18-1922b24920bf tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.259363 Feb 28 10:36:20.011332 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 325/612] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:19 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:20.059143 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-11919cd5-a843-4057-993e-3b06fdf9758d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:36:20.063016 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-11919cd5-a843-4057-993e-3b06fdf9758d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for user 9f32c16ee62d441d9e5fde2b1ce0afaf and project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:36:20.075861 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-11919cd5-a843-4057-993e-3b06fdf9758d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.117509 Feb 28 10:36:20.076502 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 288/613] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 10:36:19 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:20.112407 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:20.113022 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:20.118803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:20.119251 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:20.120038 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:20.120487 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:20.266964 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:20.274666 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:20.276173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:20.277810 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d74c9c4e-809e-4a04-b3bd-cadcceefc8f5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1407 microversion: 2.20 time: 0.169256 Feb 28 10:36:20.278702 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 326/614] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:20 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:36:21.028487 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-745627a2-76d0-4d3b-9529-d7f2e74154ec tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:21.029651 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-745627a2-76d0-4d3b-9529-d7f2e74154ec tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:21.035623 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-745627a2-76d0-4d3b-9529-d7f2e74154ec tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:21.036080 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-745627a2-76d0-4d3b-9529-d7f2e74154ec tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:21.036936 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-745627a2-76d0-4d3b-9529-d7f2e74154ec tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:21.037601 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-745627a2-76d0-4d3b-9529-d7f2e74154ec tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:21.294896 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-745627a2-76d0-4d3b-9529-d7f2e74154ec tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:21.296162 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:21.297299 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:21.304744 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:21.305198 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:21.305995 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:21.306430 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:21.315442 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-745627a2-76d0-4d3b-9529-d7f2e74154ec tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.291206 Feb 28 10:36:21.316439 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 289/615] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:21 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:21.468711 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:21.476445 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:21.477989 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:21.479178 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-176f3b72-8323-4c1b-965e-9aae81749201 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1600 microversion: 2.20 time: 0.187509 Feb 28 10:36:21.479738 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 327/616] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:36:21 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1600 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:36:21.493428 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-725949837", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8493f9b-90f0-45ae-88f1-58848e2a93be"}], "security_groups": [{"name": "tempest-securitygroup--1163519739"}], "key_name": "tempest-keypair-1505073024", "user_data": "}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:21.497308 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-435941ea-b35d-4f60-89a8-38df61fd56ac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:21.497990 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-435941ea-b35d-4f60-89a8-38df61fd56ac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:21.503971 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-435941ea-b35d-4f60-89a8-38df61fd56ac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:21.504421 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-435941ea-b35d-4f60-89a8-38df61fd56ac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:21.505206 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-435941ea-b35d-4f60-89a8-38df61fd56ac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:21.505643 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-435941ea-b35d-4f60-89a8-38df61fd56ac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:21.619659 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-435941ea-b35d-4f60-89a8-38df61fd56ac tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.126619 Feb 28 10:36:21.620283 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 328/617] 10.222.0.21 () {60 vars in 1315 bytes} [Mon Feb 28 10:36:21 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 10:36:21.623974 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] validate_networks() for [('f8493f9b-90f0-45ae-88f1-58848e2a93be', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:36:22.333216 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5e79cd9f-4c6d-4b08-954f-032957735d42 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:22.334082 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5e79cd9f-4c6d-4b08-954f-032957735d42 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:22.341109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5e79cd9f-4c6d-4b08-954f-032957735d42 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:22.341950 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5e79cd9f-4c6d-4b08-954f-032957735d42 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:22.342866 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5e79cd9f-4c6d-4b08-954f-032957735d42 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:22.343415 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5e79cd9f-4c6d-4b08-954f-032957735d42 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:22.733961 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5e79cd9f-4c6d-4b08-954f-032957735d42 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:22.743936 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5e79cd9f-4c6d-4b08-954f-032957735d42 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.414792 Feb 28 10:36:22.744702 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 329/618] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:22 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:36:22.750892 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:36:22.751948 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:36:22.752589 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:36:22.753148 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:36:22.753849 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:36:22.767491 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:22.768118 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:22.769055 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:22.769491 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:22.790496 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:36:22.798128 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Getting quotas for user 9f32c16ee62d441d9e5fde2b1ce0afaf and project 17631b0e5f9d499f9b830044f7acffa5. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:36:22.811481 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:36:22.813891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:36:22.873194 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-26124102-4001-41e2-b288-e430912c09ea tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.383935 Feb 28 10:36:22.875587 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 290/619] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:36:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:36:22.885862 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f8defd6f-1c2f-4609-ab58-ee8dd927db55 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:22.886586 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f8defd6f-1c2f-4609-ab58-ee8dd927db55 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:22.982368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f8defd6f-1c2f-4609-ab58-ee8dd927db55 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:22.994682 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f8defd6f-1c2f-4609-ab58-ee8dd927db55 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1237 microversion: 2.1 time: 0.113150 Feb 28 10:36:22.995524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 330/620] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:22 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1237 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:23.319064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-82833fdf-396c-401e-a79a-14b2b0a40297 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:23.319571 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-82833fdf-396c-401e-a79a-14b2b0a40297 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:23.348487 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-82833fdf-396c-401e-a79a-14b2b0a40297 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:23.349306 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-82833fdf-396c-401e-a79a-14b2b0a40297 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:23.350576 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-82833fdf-396c-401e-a79a-14b2b0a40297 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:23.351397 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-82833fdf-396c-401e-a79a-14b2b0a40297 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:23.353137 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-992573be-2529-4cd8-8f3f-4a0d5649d286 req-5ed01eb7-42f7-4e36-a23f-bd677b48b6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d16ba15-2ef6-4ce9-a9cd-d5e14657271a", "tag": "c091db1b-3683-4633-8290-5a1701243cc7"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:23.371287 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-992573be-2529-4cd8-8f3f-4a0d5649d286 req-5ed01eb7-42f7-4e36-a23f-bd677b48b6ad service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:23.371950 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-992573be-2529-4cd8-8f3f-4a0d5649d286 req-5ed01eb7-42f7-4e36-a23f-bd677b48b6ad service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:23.389640 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-992573be-2529-4cd8-8f3f-4a0d5649d286 req-5ed01eb7-42f7-4e36-a23f-bd677b48b6ad service nova] Creating event network-changed:c091db1b-3683-4633-8290-5a1701243cc7 for instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a on hv-cinder-maste Feb 28 10:36:23.395597 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-82833fdf-396c-401e-a79a-14b2b0a40297 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/ips" status: 200 len: 113 microversion: 2.20 time: 0.081063 Feb 28 10:36:23.396288 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-992573be-2529-4cd8-8f3f-4a0d5649d286 req-5ed01eb7-42f7-4e36-a23f-bd677b48b6ad service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047978 Feb 28 10:36:23.396774 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 291/621] 10.222.0.21 () {60 vars in 1288 bytes} [Mon Feb 28 10:36:23 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/ips => generated 113 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:36:23.397464 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 331/622] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:23.764499 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a977c906-3c31-4c8e-bf0d-f3856db4d119 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:23.765163 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a977c906-3c31-4c8e-bf0d-f3856db4d119 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:23.779382 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a977c906-3c31-4c8e-bf0d-f3856db4d119 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:23.779833 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a977c906-3c31-4c8e-bf0d-f3856db4d119 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:23.780812 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a977c906-3c31-4c8e-bf0d-f3856db4d119 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:23.787321 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a977c906-3c31-4c8e-bf0d-f3856db4d119 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:24.013737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6b422dee-a9b4-405e-9667-6e64258a7865 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:24.014804 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6b422dee-a9b4-405e-9667-6e64258a7865 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:24.021924 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6b422dee-a9b4-405e-9667-6e64258a7865 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:24.022461 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6b422dee-a9b4-405e-9667-6e64258a7865 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:24.023366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6b422dee-a9b4-405e-9667-6e64258a7865 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:24.023894 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6b422dee-a9b4-405e-9667-6e64258a7865 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:24.109625 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a977c906-3c31-4c8e-bf0d-f3856db4d119 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:24.120382 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a977c906-3c31-4c8e-bf0d-f3856db4d119 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.360832 Feb 28 10:36:24.134660 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 292/623] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:23 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:24.163424 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6b422dee-a9b4-405e-9667-6e64258a7865 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:24.175098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6b422dee-a9b4-405e-9667-6e64258a7865 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1297 microversion: 2.1 time: 0.166326 Feb 28 10:36:24.175681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 332/624] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:24 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1297 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:36:25.142081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5ba47e20-40b4-4365-ad91-b7c2d47f6737 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:25.142769 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5ba47e20-40b4-4365-ad91-b7c2d47f6737 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:25.150345 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ba47e20-40b4-4365-ad91-b7c2d47f6737 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:25.151014 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ba47e20-40b4-4365-ad91-b7c2d47f6737 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:25.151932 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ba47e20-40b4-4365-ad91-b7c2d47f6737 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:25.152994 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5ba47e20-40b4-4365-ad91-b7c2d47f6737 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:25.192109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d0bb76a2-d0eb-4146-bc62-74dadfd82ff4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:25.192736 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d0bb76a2-d0eb-4146-bc62-74dadfd82ff4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:25.199723 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0bb76a2-d0eb-4146-bc62-74dadfd82ff4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:25.200526 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0bb76a2-d0eb-4146-bc62-74dadfd82ff4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:25.201539 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0bb76a2-d0eb-4146-bc62-74dadfd82ff4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:25.201982 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d0bb76a2-d0eb-4146-bc62-74dadfd82ff4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:25.671811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5ba47e20-40b4-4365-ad91-b7c2d47f6737 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:25.684132 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5ba47e20-40b4-4365-ad91-b7c2d47f6737 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1755 microversion: 2.1 time: 0.547526 Feb 28 10:36:25.685030 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 293/625] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:25 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1755 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:25.703524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d0bb76a2-d0eb-4146-bc62-74dadfd82ff4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:25.712325 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d0bb76a2-d0eb-4146-bc62-74dadfd82ff4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1363 microversion: 2.1 time: 0.524019 Feb 28 10:36:25.722799 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 333/626] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:25 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1363 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:36:25.759616 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-0702cd42-b8f0-4e07-82b9-6b84996b63a8 req-31cd3671-37a5-47c5-924f-04a50da66fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad6d17ae-b508-4ec1-a450-1f325d00cbfe", "tag": "3998f5f5-8181-4944-8dc7-820afb186d3b"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:25.769577 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-0702cd42-b8f0-4e07-82b9-6b84996b63a8 req-31cd3671-37a5-47c5-924f-04a50da66fb8 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:25.770019 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-0702cd42-b8f0-4e07-82b9-6b84996b63a8 req-31cd3671-37a5-47c5-924f-04a50da66fb8 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:25.783067 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-0702cd42-b8f0-4e07-82b9-6b84996b63a8 req-31cd3671-37a5-47c5-924f-04a50da66fb8 service nova] Creating event network-changed:3998f5f5-8181-4944-8dc7-820afb186d3b for instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe on hv-cinder-maste Feb 28 10:36:25.796984 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-0702cd42-b8f0-4e07-82b9-6b84996b63a8 req-31cd3671-37a5-47c5-924f-04a50da66fb8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039790 Feb 28 10:36:25.797951 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 294/627] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:26.703772 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3a497b85-1def-4a8a-a7ac-f5d21cdfce53 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:26.704415 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3a497b85-1def-4a8a-a7ac-f5d21cdfce53 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:26.710382 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3a497b85-1def-4a8a-a7ac-f5d21cdfce53 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:26.710866 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3a497b85-1def-4a8a-a7ac-f5d21cdfce53 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:26.711653 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3a497b85-1def-4a8a-a7ac-f5d21cdfce53 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:26.712118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3a497b85-1def-4a8a-a7ac-f5d21cdfce53 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:26.730765 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9bde93ed-e45b-4e17-8f9d-a9afa8177231 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:26.731542 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9bde93ed-e45b-4e17-8f9d-a9afa8177231 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:26.738789 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9bde93ed-e45b-4e17-8f9d-a9afa8177231 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:26.739240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9bde93ed-e45b-4e17-8f9d-a9afa8177231 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:26.740046 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9bde93ed-e45b-4e17-8f9d-a9afa8177231 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:26.740467 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9bde93ed-e45b-4e17-8f9d-a9afa8177231 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:26.939963 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3a497b85-1def-4a8a-a7ac-f5d21cdfce53 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:26.950217 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3a497b85-1def-4a8a-a7ac-f5d21cdfce53 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1758 microversion: 2.1 time: 0.250641 Feb 28 10:36:26.951947 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 334/628] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:26 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1758 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:26.958326 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9bde93ed-e45b-4e17-8f9d-a9afa8177231 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:26.967521 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9bde93ed-e45b-4e17-8f9d-a9afa8177231 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1363 microversion: 2.1 time: 0.241730 Feb 28 10:36:26.968611 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 295/629] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:26 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:36:27.985255 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ac8d5688-8599-4a51-b3ad-98d63fe24700 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:27.985863 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ac8d5688-8599-4a51-b3ad-98d63fe24700 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:27.992154 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac8d5688-8599-4a51-b3ad-98d63fe24700 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:27.992607 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac8d5688-8599-4a51-b3ad-98d63fe24700 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:27.993383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac8d5688-8599-4a51-b3ad-98d63fe24700 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:27.993819 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ac8d5688-8599-4a51-b3ad-98d63fe24700 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:28.129829 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ac8d5688-8599-4a51-b3ad-98d63fe24700 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:28.138266 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ac8d5688-8599-4a51-b3ad-98d63fe24700 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1363 microversion: 2.1 time: 0.156781 Feb 28 10:36:28.138874 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 335/630] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:27 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:29.155964 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e145d456-f023-4728-9077-74e56accae38 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:29.156583 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e145d456-f023-4728-9077-74e56accae38 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:29.162827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e145d456-f023-4728-9077-74e56accae38 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:29.163307 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e145d456-f023-4728-9077-74e56accae38 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:29.164069 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e145d456-f023-4728-9077-74e56accae38 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:29.164576 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e145d456-f023-4728-9077-74e56accae38 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:29.307241 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e145d456-f023-4728-9077-74e56accae38 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:29.314554 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e145d456-f023-4728-9077-74e56accae38 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1363 microversion: 2.1 time: 0.163120 Feb 28 10:36:29.315139 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 296/631] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:29 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:30.331779 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ea448e23-d6b2-4b70-a5ea-8fbfd0d4e48f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:30.332392 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ea448e23-d6b2-4b70-a5ea-8fbfd0d4e48f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:30.338721 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea448e23-d6b2-4b70-a5ea-8fbfd0d4e48f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:30.339168 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea448e23-d6b2-4b70-a5ea-8fbfd0d4e48f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:30.341251 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea448e23-d6b2-4b70-a5ea-8fbfd0d4e48f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:30.341947 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ea448e23-d6b2-4b70-a5ea-8fbfd0d4e48f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:30.477364 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ea448e23-d6b2-4b70-a5ea-8fbfd0d4e48f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:30.484674 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ea448e23-d6b2-4b70-a5ea-8fbfd0d4e48f tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1363 microversion: 2.1 time: 0.156915 Feb 28 10:36:30.485232 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 336/632] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:30 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:30.778901 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-47cb35fb-3d9a-4ba9-aa64-2a7929d4e3a4 req-6e4e3e8d-15d3-450c-802a-ccb10ee8bd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6d17ae-b508-4ec1-a450-1f325d00cbfe", "name": "network-vif-plugged", "status": "completed", "tag": "3998f5f5-8181-4944-8dc7-820afb186d3b"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:30.787541 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-47cb35fb-3d9a-4ba9-aa64-2a7929d4e3a4 req-6e4e3e8d-15d3-450c-802a-ccb10ee8bd93 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:30.788075 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-47cb35fb-3d9a-4ba9-aa64-2a7929d4e3a4 req-6e4e3e8d-15d3-450c-802a-ccb10ee8bd93 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:30.800068 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-47cb35fb-3d9a-4ba9-aa64-2a7929d4e3a4 req-6e4e3e8d-15d3-450c-802a-ccb10ee8bd93 service nova] Creating event network-vif-plugged:3998f5f5-8181-4944-8dc7-820afb186d3b for instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe on hv-cinder-maste Feb 28 10:36:30.805160 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-47cb35fb-3d9a-4ba9-aa64-2a7929d4e3a4 req-6e4e3e8d-15d3-450c-802a-ccb10ee8bd93 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030555 Feb 28 10:36:30.806033 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 297/633] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:31.505218 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-83961db6-ee52-4a70-9376-c43b579c1b20 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:31.505828 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-83961db6-ee52-4a70-9376-c43b579c1b20 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:31.512721 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-83961db6-ee52-4a70-9376-c43b579c1b20 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:31.513162 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-83961db6-ee52-4a70-9376-c43b579c1b20 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:31.513937 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-83961db6-ee52-4a70-9376-c43b579c1b20 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:31.514370 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-83961db6-ee52-4a70-9376-c43b579c1b20 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:31.652559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-83961db6-ee52-4a70-9376-c43b579c1b20 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:31.659724 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-83961db6-ee52-4a70-9376-c43b579c1b20 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1363 microversion: 2.1 time: 0.158346 Feb 28 10:36:31.660292 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 337/634] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:31 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:32.678715 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4d2bdc65-a06b-4196-8f1e-2ff8b0929929 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:32.679427 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4d2bdc65-a06b-4196-8f1e-2ff8b0929929 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:32.685732 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4d2bdc65-a06b-4196-8f1e-2ff8b0929929 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:32.686184 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4d2bdc65-a06b-4196-8f1e-2ff8b0929929 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:32.687000 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4d2bdc65-a06b-4196-8f1e-2ff8b0929929 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:32.687438 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4d2bdc65-a06b-4196-8f1e-2ff8b0929929 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:32.826235 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4d2bdc65-a06b-4196-8f1e-2ff8b0929929 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:36:32.833444 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4d2bdc65-a06b-4196-8f1e-2ff8b0929929 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1550 microversion: 2.1 time: 0.160080 Feb 28 10:36:32.833997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 298/635] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:36:32 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:36:32.850926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6803b598-c3ec-488c-af70-4023c5308569 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:32.851449 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6803b598-c3ec-488c-af70-4023c5308569 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:32.858407 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6803b598-c3ec-488c-af70-4023c5308569 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:32.858887 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6803b598-c3ec-488c-af70-4023c5308569 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:32.859678 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6803b598-c3ec-488c-af70-4023c5308569 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:32.860113 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6803b598-c3ec-488c-af70-4023c5308569 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:32.943363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6803b598-c3ec-488c-af70-4023c5308569 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096259 Feb 28 10:36:32.943959 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 338/636] 10.222.0.21 () {58 vars in 1274 bytes} [Mon Feb 28 10:36:32 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:36:33.944611 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-627f804a-e5e9-40f7-ac1a-d8e6865bfe52 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:33.946010 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-627f804a-e5e9-40f7-ac1a-d8e6865bfe52 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:33.947363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-578dbfa7-7bdc-45c4-b8ef-e7db48d38854 req-55de6974-4c1e-4d7b-a425-683d8d9dacef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad6d17ae-b508-4ec1-a450-1f325d00cbfe", "tag": "3998f5f5-8181-4944-8dc7-820afb186d3b"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:33.953580 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-627f804a-e5e9-40f7-ac1a-d8e6865bfe52 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:33.956340 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-578dbfa7-7bdc-45c4-b8ef-e7db48d38854 req-55de6974-4c1e-4d7b-a425-683d8d9dacef service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:33.956896 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-578dbfa7-7bdc-45c4-b8ef-e7db48d38854 req-55de6974-4c1e-4d7b-a425-683d8d9dacef service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:33.958851 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-627f804a-e5e9-40f7-ac1a-d8e6865bfe52 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:33.960007 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-627f804a-e5e9-40f7-ac1a-d8e6865bfe52 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:33.961532 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-627f804a-e5e9-40f7-ac1a-d8e6865bfe52 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:33.970400 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-578dbfa7-7bdc-45c4-b8ef-e7db48d38854 req-55de6974-4c1e-4d7b-a425-683d8d9dacef service nova] Creating event network-changed:3998f5f5-8181-4944-8dc7-820afb186d3b for instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe on hv-cinder-maste Feb 28 10:36:33.975524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-578dbfa7-7bdc-45c4-b8ef-e7db48d38854 req-55de6974-4c1e-4d7b-a425-683d8d9dacef service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032660 Feb 28 10:36:33.976658 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 339/637] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:33.985501 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-627f804a-e5e9-40f7-ac1a-d8e6865bfe52 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/ips" status: 200 len: 107 microversion: 2.1 time: 0.045054 Feb 28 10:36:33.986108 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 299/638] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 10:36:33 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/ips => generated 107 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:35.358834 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4d9918a0-583c-4f95-a318-7c22d7db87e6 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af6ec5db-f6a3-4db9-99dd-f12a94398ae7"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:35.360044 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4d9918a0-583c-4f95-a318-7c22d7db87e6 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:35.366875 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4d9918a0-583c-4f95-a318-7c22d7db87e6 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:35.367330 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4d9918a0-583c-4f95-a318-7c22d7db87e6 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:35.368157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4d9918a0-583c-4f95-a318-7c22d7db87e6 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:35.368697 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4d9918a0-583c-4f95-a318-7c22d7db87e6 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:35.780398 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4d9918a0-583c-4f95-a318-7c22d7db87e6 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425774 Feb 28 10:36:35.781079 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 340/639] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:36:35 2022] POST /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:43.266201 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d28fff89-0f20-4366-8d0b-216513ce4141 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:43.267148 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d28fff89-0f20-4366-8d0b-216513ce4141 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:43.272918 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d28fff89-0f20-4366-8d0b-216513ce4141 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:43.273372 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d28fff89-0f20-4366-8d0b-216513ce4141 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:43.274153 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d28fff89-0f20-4366-8d0b-216513ce4141 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:43.274613 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d28fff89-0f20-4366-8d0b-216513ce4141 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:43.302459 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d28fff89-0f20-4366-8d0b-216513ce4141 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040824 Feb 28 10:36:43.303037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 300/640] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:36:43 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:43.314462 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-331b170d-0094-40e4-9fd9-11af3a8f43ce tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:43.315118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-331b170d-0094-40e4-9fd9-11af3a8f43ce tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:43.321146 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-331b170d-0094-40e4-9fd9-11af3a8f43ce tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:43.321594 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-331b170d-0094-40e4-9fd9-11af3a8f43ce tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:43.322371 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-331b170d-0094-40e4-9fd9-11af3a8f43ce tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:43.322833 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-331b170d-0094-40e4-9fd9-11af3a8f43ce tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:43.350201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-331b170d-0094-40e4-9fd9-11af3a8f43ce tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/af6ec5db-f6a3-4db9-99dd-f12a94398ae7" status: 200 len: 194 microversion: 2.1 time: 0.040671 Feb 28 10:36:43.350791 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 341/641] 10.222.0.21 () {58 vars in 1412 bytes} [Mon Feb 28 10:36:43 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/af6ec5db-f6a3-4db9-99dd-f12a94398ae7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:44.666039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-39e8aafd-3a79-4dd2-841c-bfb0a3e80530 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "309cab97-9931-4a4c-acdd-3773dd97e72f"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:44.666039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-39e8aafd-3a79-4dd2-841c-bfb0a3e80530 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:44.672946 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-39e8aafd-3a79-4dd2-841c-bfb0a3e80530 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:44.673397 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-39e8aafd-3a79-4dd2-841c-bfb0a3e80530 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:44.674187 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-39e8aafd-3a79-4dd2-841c-bfb0a3e80530 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:44.674665 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-39e8aafd-3a79-4dd2-841c-bfb0a3e80530 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:45.143883 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-39e8aafd-3a79-4dd2-841c-bfb0a3e80530 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "POST /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483328 Feb 28 10:36:45.144492 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 301/642] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:36:44 2022] POST /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:36:52.783854 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-05038082-bb92-4e26-b0a6-441fd0a173e1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:36:52.785469 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-05038082-bb92-4e26-b0a6-441fd0a173e1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:36:52.792381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-05038082-bb92-4e26-b0a6-441fd0a173e1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:52.793886 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-05038082-bb92-4e26-b0a6-441fd0a173e1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:52.796151 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-05038082-bb92-4e26-b0a6-441fd0a173e1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:36:52.796774 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-05038082-bb92-4e26-b0a6-441fd0a173e1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:36:52.851560 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-05038082-bb92-4e26-b0a6-441fd0a173e1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.071606 Feb 28 10:36:52.852404 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 342/643] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:36:52 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:36:54.925042 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d1ee8105-39d1-44bb-8571-f00b0367e233 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Action: 'create', calling method: .version_select at 0x7f1c58220700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1951691794"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:36:54.947758 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-d1ee8105-39d1-44bb-8571-f00b0367e233 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:36:54.952946 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-d1ee8105-39d1-44bb-8571-f00b0367e233 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for user bcd74c3c272a427ba2e362c19cdbad8a and project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:36:55.322555 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-d1ee8105-39d1-44bb-8571-f00b0367e233 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:36:55.326356 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-d1ee8105-39d1-44bb-8571-f00b0367e233 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for user bcd74c3c272a427ba2e362c19cdbad8a and project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'key_pairs'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:36:55.340302 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d1ee8105-39d1-44bb-8571-f00b0367e233 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.600386 Feb 28 10:36:55.341080 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 302/644] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 10:36:54 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:09.597037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-22484341-a686-4b46-86dd-2488e60511a8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:09.597586 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-22484341-a686-4b46-86dd-2488e60511a8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:09.603345 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-22484341-a686-4b46-86dd-2488e60511a8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:09.603790 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-22484341-a686-4b46-86dd-2488e60511a8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:09.604562 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-22484341-a686-4b46-86dd-2488e60511a8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:09.604995 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-22484341-a686-4b46-86dd-2488e60511a8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:09.626761 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-22484341-a686-4b46-86dd-2488e60511a8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lazy-loading 'flavor' on Instance uuid 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:37:09.882377 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-22484341-a686-4b46-86dd-2488e60511a8 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/action" status: 202 len: 0 microversion: 2.20 time: 0.394670 Feb 28 10:37:09.883042 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 343/645] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Feb 28 10:37:09 2022] POST /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:37:09.892083 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:09.892826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:09.899263 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:09.899705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:09.900492 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:09.900923 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:10.043342 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:10.051030 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:10.052537 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:10.053686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-aa67ccbe-28c8-4110-9f2d-fbed4fb1b0cf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.165532 Feb 28 10:37:10.054242 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 303/646] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:09 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:11.072258 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:11.072984 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:11.079201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:11.079674 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:11.080438 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:11.080874 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:11.216762 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:11.224719 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:11.226219 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:11.227409 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9856384e-f298-493f-9f3a-15d1ae8173af tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.159929 Feb 28 10:37:11.227964 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 344/647] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:11 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:12.245389 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:12.245987 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:12.252792 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:12.253240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:12.254017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:12.254449 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:12.392833 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:12.401900 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:12.404359 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:12.405521 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-77f46d09-6c42-43d6-b19b-eff662648fa5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.164194 Feb 28 10:37:12.406069 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 304/648] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:12 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:13.423684 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:13.424366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:13.430537 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:13.431011 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:13.431782 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:13.432211 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:13.576084 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:13.584903 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:13.586422 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:13.588006 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-34531823-4bbb-4c15-a560-8dd47a444b90 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.168275 Feb 28 10:37:13.588587 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 345/649] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:13 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:13.647282 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1914986346", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1951691794", "security_groups": [{"name": "tempest-secgroup-smoke-2034988073"}], "block_device_mapping_v2": [{"uuid": "0bdae82e-2b18-42fa-855c-7a68dd3d0113", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f54c5564-db90-44fd-8f80-426da1be843a"}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:13.757941 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] validate_networks() for [('f54c5564-db90-44fd-8f80-426da1be843a', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:37:14.206832 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:37:14.207263 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:37:14.207741 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:37:14.208151 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:37:14.208565 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:37:14.217657 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:14.218107 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:14.219214 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:14.219654 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:14.236089 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:37:14.239911 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for user bcd74c3c272a427ba2e362c19cdbad8a and project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:37:14.294501 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:37:14.296617 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0bdae82e-2b18-42fa-855c-7a68dd3d0113',volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:37:14.419349 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3ef3663a-677d-4d56-8d78-1090b3508fca tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775848 Feb 28 10:37:14.420286 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 305/650] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:37:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:37:14.430019 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e759d169-33fd-4fe5-98bd-ca8b7c0d2d27 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:14.431210 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e759d169-33fd-4fe5-98bd-ca8b7c0d2d27 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:14.484651 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e759d169-33fd-4fe5-98bd-ca8b7c0d2d27 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:14.491115 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e759d169-33fd-4fe5-98bd-ca8b7c0d2d27 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1095 microversion: 2.1 time: 0.064995 Feb 28 10:37:14.492171 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 346/651] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:14 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:14.607722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:14.608425 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:14.614826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:14.615282 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:14.616070 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:14.616507 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:14.758644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:14.766997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:14.768592 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:14.770058 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4f623a65-0ed9-40a3-9635-247c7526fcff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.166876 Feb 28 10:37:14.770705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 306/652] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:14 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:15.509106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2d0af177-9ef8-44d7-b46d-b9f5dbccfd91 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:15.509719 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2d0af177-9ef8-44d7-b46d-b9f5dbccfd91 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:15.516050 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d0af177-9ef8-44d7-b46d-b9f5dbccfd91 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:15.516533 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d0af177-9ef8-44d7-b46d-b9f5dbccfd91 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:15.517325 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d0af177-9ef8-44d7-b46d-b9f5dbccfd91 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:15.517767 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d0af177-9ef8-44d7-b46d-b9f5dbccfd91 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:15.529723 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-983864fb-bc89-4a26-bc33-8d39b139a2c1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:15.530283 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-983864fb-bc89-4a26-bc33-8d39b139a2c1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:15.536700 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-983864fb-bc89-4a26-bc33-8d39b139a2c1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:15.537152 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-983864fb-bc89-4a26-bc33-8d39b139a2c1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:15.537942 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-983864fb-bc89-4a26-bc33-8d39b139a2c1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:15.538382 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-983864fb-bc89-4a26-bc33-8d39b139a2c1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:15.567662 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-983864fb-bc89-4a26-bc33-8d39b139a2c1 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/af6ec5db-f6a3-4db9-99dd-f12a94398ae7" status: 200 len: 194 microversion: 2.1 time: 0.143900 Feb 28 10:37:15.568274 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 347/653] 10.222.0.21 () {58 vars in 1412 bytes} [Mon Feb 28 10:37:15 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/af6ec5db-f6a3-4db9-99dd-f12a94398ae7 => generated 194 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:15.579335 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-759cd96c-25e7-494f-9f54-fa9e9e810f9a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:15.579835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-759cd96c-25e7-494f-9f54-fa9e9e810f9a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:15.587261 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2d0af177-9ef8-44d7-b46d-b9f5dbccfd91 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:15.589975 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-759cd96c-25e7-494f-9f54-fa9e9e810f9a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:15.591033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-759cd96c-25e7-494f-9f54-fa9e9e810f9a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:15.592362 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-759cd96c-25e7-494f-9f54-fa9e9e810f9a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:15.592952 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-759cd96c-25e7-494f-9f54-fa9e9e810f9a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:15.596242 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2d0af177-9ef8-44d7-b46d-b9f5dbccfd91 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1193 microversion: 2.1 time: 0.090735 Feb 28 10:37:15.608583 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 307/654] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:15 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:15.680533 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-759cd96c-25e7-494f-9f54-fa9e9e810f9a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lazy-loading 'services' on Instance uuid ad6d17ae-b508-4ec1-a450-1f325d00cbfe {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:37:15.757344 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-759cd96c-25e7-494f-9f54-fa9e9e810f9a tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/af6ec5db-f6a3-4db9-99dd-f12a94398ae7" status: 202 len: 0 microversion: 2.1 time: 0.182859 Feb 28 10:37:15.757990 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 348/655] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:37:15 2022] DELETE /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/af6ec5db-f6a3-4db9-99dd-f12a94398ae7 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 28 10:37:15.789710 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:15.791200 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:15.801295 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:15.802033 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:15.803346 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:15.804706 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:15.957994 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:15.966316 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:15.968096 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:15.969568 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f0200381-a354-4cbb-a52d-ee57643661f4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.184265 Feb 28 10:37:15.970303 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 308/656] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:15 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:16.618361 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4207bc3c-7dd0-4539-87e7-e386a6f1cc60 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:16.619016 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4207bc3c-7dd0-4539-87e7-e386a6f1cc60 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:16.632250 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4207bc3c-7dd0-4539-87e7-e386a6f1cc60 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:16.633339 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4207bc3c-7dd0-4539-87e7-e386a6f1cc60 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:16.634300 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4207bc3c-7dd0-4539-87e7-e386a6f1cc60 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:16.634946 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4207bc3c-7dd0-4539-87e7-e386a6f1cc60 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:16.786879 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4207bc3c-7dd0-4539-87e7-e386a6f1cc60 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:16.794685 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4207bc3c-7dd0-4539-87e7-e386a6f1cc60 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1279 microversion: 2.1 time: 0.180510 Feb 28 10:37:16.795469 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 349/657] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:16 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1279 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:16.988497 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:16.989840 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:16.999040 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:16.999920 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:17.002232 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:17.002799 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:17.172180 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:17.180676 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:17.182300 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:17.184693 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c81a12ed-0e13-4aab-8de6-829dbe14d9b1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.198997 Feb 28 10:37:17.185452 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 309/658] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:16 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:17.480731 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-4bb04c74-436b-4a74-b9ca-54d631ce591e req-ac584cfa-6931-44ff-bd35-c42d414d49c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1357a1-2e5f-4972-91cc-f16f95ebeb23", "tag": "529b48cb-8201-4cd7-9a2e-93e7994b3a10"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:17.491118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-4bb04c74-436b-4a74-b9ca-54d631ce591e req-ac584cfa-6931-44ff-bd35-c42d414d49c6 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:17.491714 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-4bb04c74-436b-4a74-b9ca-54d631ce591e req-ac584cfa-6931-44ff-bd35-c42d414d49c6 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:17.505708 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-4bb04c74-436b-4a74-b9ca-54d631ce591e req-ac584cfa-6931-44ff-bd35-c42d414d49c6 service nova] Creating event network-changed:529b48cb-8201-4cd7-9a2e-93e7994b3a10 for instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 on hv-cinder-maste Feb 28 10:37:17.511234 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-4bb04c74-436b-4a74-b9ca-54d631ce591e req-ac584cfa-6931-44ff-bd35-c42d414d49c6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121024 Feb 28 10:37:17.512173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 350/659] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:17.812635 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a274a052-1f13-491c-b97d-c71650e03a1b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:17.813418 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a274a052-1f13-491c-b97d-c71650e03a1b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:17.819431 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a274a052-1f13-491c-b97d-c71650e03a1b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:17.819886 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a274a052-1f13-491c-b97d-c71650e03a1b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:17.820665 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a274a052-1f13-491c-b97d-c71650e03a1b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:17.821099 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a274a052-1f13-491c-b97d-c71650e03a1b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:17.955905 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-daa31a39-788e-4aca-bd61-f812231ed1f7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:17.956578 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-daa31a39-788e-4aca-bd61-f812231ed1f7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:17.957964 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a274a052-1f13-491c-b97d-c71650e03a1b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:17.962853 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-daa31a39-788e-4aca-bd61-f812231ed1f7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:17.963384 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-daa31a39-788e-4aca-bd61-f812231ed1f7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:17.964242 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-daa31a39-788e-4aca-bd61-f812231ed1f7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:17.965449 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-daa31a39-788e-4aca-bd61-f812231ed1f7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:17.966508 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a274a052-1f13-491c-b97d-c71650e03a1b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.158514 Feb 28 10:37:17.967106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 310/660] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:17 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:17.994205 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-daa31a39-788e-4aca-bd61-f812231ed1f7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/309cab97-9931-4a4c-acdd-3773dd97e72f" status: 200 len: 194 microversion: 2.1 time: 0.043445 Feb 28 10:37:17.994815 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 351/661] 10.222.0.21 () {58 vars in 1412 bytes} [Mon Feb 28 10:37:17 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/309cab97-9931-4a4c-acdd-3773dd97e72f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:37:18.004670 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-94f787bb-8471-4a0d-bb14-5f68dec09915 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:18.005234 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-94f787bb-8471-4a0d-bb14-5f68dec09915 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:18.011350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-94f787bb-8471-4a0d-bb14-5f68dec09915 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:18.011802 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-94f787bb-8471-4a0d-bb14-5f68dec09915 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:18.012576 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-94f787bb-8471-4a0d-bb14-5f68dec09915 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:18.013004 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-94f787bb-8471-4a0d-bb14-5f68dec09915 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:18.092306 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-94f787bb-8471-4a0d-bb14-5f68dec09915 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lazy-loading 'services' on Instance uuid ad6d17ae-b508-4ec1-a450-1f325d00cbfe {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:37:18.166229 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-94f787bb-8471-4a0d-bb14-5f68dec09915 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/309cab97-9931-4a4c-acdd-3773dd97e72f" status: 202 len: 0 microversion: 2.1 time: 0.165361 Feb 28 10:37:18.166842 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 311/662] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:37:17 2022] DELETE /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments/309cab97-9931-4a4c-acdd-3773dd97e72f => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:37:18.211493 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:18.212412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:18.223272 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:18.223852 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:18.224663 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:18.225164 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:18.361038 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:18.368973 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:18.370503 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:18.371722 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3a2fdd95-4e43-4b4d-8cd5-ef4ca3114ff4 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.173200 Feb 28 10:37:18.372278 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 352/663] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:18 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:18.984200 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-19d1d61f-b6e3-4883-99cd-41c94388a149 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:18.984938 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-19d1d61f-b6e3-4883-99cd-41c94388a149 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:18.991080 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-19d1d61f-b6e3-4883-99cd-41c94388a149 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:18.991531 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-19d1d61f-b6e3-4883-99cd-41c94388a149 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:18.992315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-19d1d61f-b6e3-4883-99cd-41c94388a149 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:18.992749 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-19d1d61f-b6e3-4883-99cd-41c94388a149 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.131290 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-19d1d61f-b6e3-4883-99cd-41c94388a149 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:19.139859 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-19d1d61f-b6e3-4883-99cd-41c94388a149 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.159995 Feb 28 10:37:19.140435 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 312/664] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:18 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:19.325374 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9befbc51-ac37-45be-a8a1-3e4f63ef730d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:19.326375 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9befbc51-ac37-45be-a8a1-3e4f63ef730d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:19.332583 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9befbc51-ac37-45be-a8a1-3e4f63ef730d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.333036 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9befbc51-ac37-45be-a8a1-3e4f63ef730d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.333813 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9befbc51-ac37-45be-a8a1-3e4f63ef730d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.334246 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9befbc51-ac37-45be-a8a1-3e4f63ef730d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.361677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9befbc51-ac37-45be-a8a1-3e4f63ef730d tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041233 Feb 28 10:37:19.362200 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 353/665] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:37:19 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 10:37:19.390146 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:19.390858 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:19.396837 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.397354 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.398131 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.398586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.474245 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5be64cb3-db6b-440d-b2fd-d680e05c252c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:19.475221 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5be64cb3-db6b-440d-b2fd-d680e05c252c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:19.482228 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5be64cb3-db6b-440d-b2fd-d680e05c252c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.482709 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5be64cb3-db6b-440d-b2fd-d680e05c252c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.483503 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5be64cb3-db6b-440d-b2fd-d680e05c252c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.483968 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5be64cb3-db6b-440d-b2fd-d680e05c252c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.514213 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5be64cb3-db6b-440d-b2fd-d680e05c252c tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043916 Feb 28 10:37:19.517266 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 354/666] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:37:19 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 10:37:19.540561 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:19.548363 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:19.549954 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:19.551103 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b8a27f57-0b30-4f2d-b861-7a3433bf104a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.165827 Feb 28 10:37:19.551663 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 313/667] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:19 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:19.577007 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6c5a1edc-41d3-4c99-beca-e73a81408e15 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:19.577503 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6c5a1edc-41d3-4c99-beca-e73a81408e15 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:19.583308 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6c5a1edc-41d3-4c99-beca-e73a81408e15 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.583752 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6c5a1edc-41d3-4c99-beca-e73a81408e15 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.584520 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6c5a1edc-41d3-4c99-beca-e73a81408e15 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.584951 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6c5a1edc-41d3-4c99-beca-e73a81408e15 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.609845 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6c5a1edc-41d3-4c99-beca-e73a81408e15 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:37:19.692935 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6c5a1edc-41d3-4c99-beca-e73a81408e15 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 204 len: 0 microversion: 2.1 time: 0.121436 Feb 28 10:37:19.693617 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 355/668] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:37:19 2022] DELETE /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:37:19.702700 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5acf5edb-ed2d-4534-a86d-8303ffa0b856 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:19.703340 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5acf5edb-ed2d-4534-a86d-8303ffa0b856 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:19.709139 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5acf5edb-ed2d-4534-a86d-8303ffa0b856 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.709588 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5acf5edb-ed2d-4534-a86d-8303ffa0b856 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.710362 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5acf5edb-ed2d-4534-a86d-8303ffa0b856 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:19.710829 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5acf5edb-ed2d-4534-a86d-8303ffa0b856 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:19.849542 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5acf5edb-ed2d-4534-a86d-8303ffa0b856 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:19.857010 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5acf5edb-ed2d-4534-a86d-8303ffa0b856 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1675 microversion: 2.1 time: 0.158925 Feb 28 10:37:19.857571 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 314/669] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:19 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:20.157542 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b87bfd4e-e1e8-4a2a-a0c8-132cbe77aa76 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:20.158235 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b87bfd4e-e1e8-4a2a-a0c8-132cbe77aa76 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:20.164048 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b87bfd4e-e1e8-4a2a-a0c8-132cbe77aa76 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:20.164499 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b87bfd4e-e1e8-4a2a-a0c8-132cbe77aa76 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:20.165281 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b87bfd4e-e1e8-4a2a-a0c8-132cbe77aa76 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:20.165723 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b87bfd4e-e1e8-4a2a-a0c8-132cbe77aa76 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:20.300772 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b87bfd4e-e1e8-4a2a-a0c8-132cbe77aa76 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:20.309247 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b87bfd4e-e1e8-4a2a-a0c8-132cbe77aa76 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.155216 Feb 28 10:37:20.309831 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 356/670] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:20 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:20.570096 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:20.570722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:20.577795 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:20.578237 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:20.579035 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:20.579469 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:20.714416 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:20.722394 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:20.723927 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:20.725076 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c7e57ab5-1185-4971-82da-ae042b36ff51 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1746 microversion: 2.20 time: 0.158972 Feb 28 10:37:20.725643 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 315/671] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:20 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:20.873343 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1b4cf239-4eb1-4bc0-8287-81cc38878921 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:20.873945 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1b4cf239-4eb1-4bc0-8287-81cc38878921 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:20.880239 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1b4cf239-4eb1-4bc0-8287-81cc38878921 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:20.880684 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1b4cf239-4eb1-4bc0-8287-81cc38878921 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:20.881461 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1b4cf239-4eb1-4bc0-8287-81cc38878921 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:20.881894 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1b4cf239-4eb1-4bc0-8287-81cc38878921 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:21.017194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1b4cf239-4eb1-4bc0-8287-81cc38878921 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:21.024398 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1b4cf239-4eb1-4bc0-8287-81cc38878921 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1675 microversion: 2.1 time: 0.155032 Feb 28 10:37:21.024956 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 357/672] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:20 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:21.326120 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-25fa4cbb-63b0-45aa-b26b-4351301c1b92 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:21.326778 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-25fa4cbb-63b0-45aa-b26b-4351301c1b92 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:21.332773 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-25fa4cbb-63b0-45aa-b26b-4351301c1b92 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:21.333220 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-25fa4cbb-63b0-45aa-b26b-4351301c1b92 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:21.334001 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-25fa4cbb-63b0-45aa-b26b-4351301c1b92 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:21.334432 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-25fa4cbb-63b0-45aa-b26b-4351301c1b92 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:21.467283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-25fa4cbb-63b0-45aa-b26b-4351301c1b92 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:21.474794 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-25fa4cbb-63b0-45aa-b26b-4351301c1b92 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.152725 Feb 28 10:37:21.475365 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 316/673] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:21 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:21.743986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:21.744515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:21.750699 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:21.751140 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:21.751907 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:21.752335 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:21.890290 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:21.898146 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:21.899679 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:21.900833 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-10bb2e09-84e7-4c34-9da6-58578d287423 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1746 microversion: 2.20 time: 0.160862 Feb 28 10:37:21.901383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 358/674] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:21 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:22.042373 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b644932b-f36e-4bad-9560-7b2d5a1e0981 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:22.043399 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b644932b-f36e-4bad-9560-7b2d5a1e0981 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:22.049423 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b644932b-f36e-4bad-9560-7b2d5a1e0981 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:22.049881 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b644932b-f36e-4bad-9560-7b2d5a1e0981 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:22.050697 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b644932b-f36e-4bad-9560-7b2d5a1e0981 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:22.051140 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b644932b-f36e-4bad-9560-7b2d5a1e0981 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:22.185865 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b644932b-f36e-4bad-9560-7b2d5a1e0981 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:22.193060 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b644932b-f36e-4bad-9560-7b2d5a1e0981 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1675 microversion: 2.1 time: 0.154595 Feb 28 10:37:22.193616 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 317/675] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:22 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:22.492380 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-70738630-1780-4c3a-b385-af949a13218e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:22.493137 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-70738630-1780-4c3a-b385-af949a13218e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:22.500142 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-70738630-1780-4c3a-b385-af949a13218e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:22.500639 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-70738630-1780-4c3a-b385-af949a13218e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:22.501414 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-70738630-1780-4c3a-b385-af949a13218e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:22.501845 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-70738630-1780-4c3a-b385-af949a13218e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:22.641875 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-70738630-1780-4c3a-b385-af949a13218e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:22.652293 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-70738630-1780-4c3a-b385-af949a13218e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.163364 Feb 28 10:37:22.653538 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 359/676] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:22 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:22.701482 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-9612ab12-466f-4d9d-a38b-e6ddf052b6b0 req-a3737126-c088-4576-a928-dd01e2fdbc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6d17ae-b508-4ec1-a450-1f325d00cbfe", "name": "network-vif-deleted", "tag": "3998f5f5-8181-4944-8dc7-820afb186d3b"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:22.709758 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-9612ab12-466f-4d9d-a38b-e6ddf052b6b0 req-a3737126-c088-4576-a928-dd01e2fdbc7c service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:22.710196 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-9612ab12-466f-4d9d-a38b-e6ddf052b6b0 req-a3737126-c088-4576-a928-dd01e2fdbc7c service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:22.722093 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-9612ab12-466f-4d9d-a38b-e6ddf052b6b0 req-a3737126-c088-4576-a928-dd01e2fdbc7c service nova] Creating event network-vif-deleted:3998f5f5-8181-4944-8dc7-820afb186d3b for instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe on hv-cinder-maste Feb 28 10:37:22.726946 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-9612ab12-466f-4d9d-a38b-e6ddf052b6b0 req-a3737126-c088-4576-a928-dd01e2fdbc7c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029764 Feb 28 10:37:22.731574 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 318/677] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:22.921740 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:22.922883 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:22.929733 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:22.930324 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:22.931311 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:22.931933 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:23.082785 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:23.092106 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:23.094272 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:23.095601 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-bfa13319-85db-42a1-94ab-e44cc9b58c8f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.179714 Feb 28 10:37:23.096477 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 360/678] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:22 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:23.211907 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:23.212615 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:23.223397 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:23.224350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:23.225868 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:23.226689 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:23.271649 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:23.272347 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:23.272960 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lazy-loading 'fault' on Instance uuid ad6d17ae-b508-4ec1-a450-1f325d00cbfe {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:37:23.325334 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32c16ee62d441d9e5fde2b1ce0afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17631b0e5f9d499f9b830044f7acffa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:23.334376 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5c6cd1f0-e418-41cc-ab7f-61c8521308bb tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 200 len: 1327 microversion: 2.1 time: 0.126113 Feb 28 10:37:23.335012 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 319/679] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:23 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 1327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:23.670786 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4ccb17ea-83ca-4137-979e-e68a0f30407b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:23.671515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4ccb17ea-83ca-4137-979e-e68a0f30407b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:23.679538 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ccb17ea-83ca-4137-979e-e68a0f30407b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:23.681115 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ccb17ea-83ca-4137-979e-e68a0f30407b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:23.684179 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ccb17ea-83ca-4137-979e-e68a0f30407b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:23.685046 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ccb17ea-83ca-4137-979e-e68a0f30407b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:23.877668 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4ccb17ea-83ca-4137-979e-e68a0f30407b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:23.888512 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4ccb17ea-83ca-4137-979e-e68a0f30407b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.222902 Feb 28 10:37:23.890550 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 361/680] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:23 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:24.115763 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:24.116488 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:24.123192 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:24.123993 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:24.125211 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:24.125721 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:24.283416 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:24.293613 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:24.295586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:24.297307 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b9a490b2-d078-425b-82b9-06aab629b352 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.185639 Feb 28 10:37:24.298581 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 320/681] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:24 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:24.355156 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a24d4a99-bd8e-4a49-afb8-8887b6bd98fd tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:24.357266 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a24d4a99-bd8e-4a49-afb8-8887b6bd98fd tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:24.364498 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a24d4a99-bd8e-4a49-afb8-8887b6bd98fd tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:24.364951 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a24d4a99-bd8e-4a49-afb8-8887b6bd98fd tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:24.365742 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a24d4a99-bd8e-4a49-afb8-8887b6bd98fd tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:24.366178 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a24d4a99-bd8e-4a49-afb8-8887b6bd98fd tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:24.382508 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-a24d4a99-bd8e-4a49-afb8-8887b6bd98fd tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] HTTP exception thrown: Instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe could not be found. Feb 28 10:37:24.383342 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a24d4a99-bd8e-4a49-afb8-8887b6bd98fd tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Returning 404 to user: Instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:37:24.384182 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a24d4a99-bd8e-4a49-afb8-8887b6bd98fd tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 404 len: 111 microversion: 2.1 time: 0.033962 Feb 28 10:37:24.387543 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 362/682] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:24 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:24.395159 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-67dc141b-4696-437d-a940-feb9c083d3de tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '.version_select at 0x7f1c5837f5e0>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:24.420206 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-67dc141b-4696-437d-a940-feb9c083d3de tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505073024" status: 202 len: 0 microversion: 2.1 time: 0.029789 Feb 28 10:37:24.421141 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 321/683] 10.222.0.21 () {58 vars in 1220 bytes} [Mon Feb 28 10:37:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505073024 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:37:24.908127 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8c157f74-bc89-454c-a8dc-0e2dcb6d2a7f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:24.910725 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8c157f74-bc89-454c-a8dc-0e2dcb6d2a7f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:24.916969 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8c157f74-bc89-454c-a8dc-0e2dcb6d2a7f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:24.922027 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8c157f74-bc89-454c-a8dc-0e2dcb6d2a7f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:24.925110 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8c157f74-bc89-454c-a8dc-0e2dcb6d2a7f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:24.925784 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8c157f74-bc89-454c-a8dc-0e2dcb6d2a7f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:25.201465 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8c157f74-bc89-454c-a8dc-0e2dcb6d2a7f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:25.222912 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8c157f74-bc89-454c-a8dc-0e2dcb6d2a7f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.320796 Feb 28 10:37:25.223807 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 363/684] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:24 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:25.253481 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-40263321-22eb-489d-899e-3b0c8b7b1158 req-e08a8658-2d60-47a9-9910-dd2f38d33b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d16ba15-2ef6-4ce9-a9cd-d5e14657271a", "name": "network-vif-plugged", "status": "completed", "tag": "c091db1b-3683-4633-8290-5a1701243cc7"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:25.268050 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-40263321-22eb-489d-899e-3b0c8b7b1158 req-e08a8658-2d60-47a9-9910-dd2f38d33b1d service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:25.268720 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-40263321-22eb-489d-899e-3b0c8b7b1158 req-e08a8658-2d60-47a9-9910-dd2f38d33b1d service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:25.281965 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-40263321-22eb-489d-899e-3b0c8b7b1158 req-e08a8658-2d60-47a9-9910-dd2f38d33b1d service nova] Creating event network-vif-plugged:c091db1b-3683-4633-8290-5a1701243cc7 for instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a on hv-cinder-maste Feb 28 10:37:25.287216 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-40263321-22eb-489d-899e-3b0c8b7b1158 req-e08a8658-2d60-47a9-9910-dd2f38d33b1d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170231 Feb 28 10:37:25.288449 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 322/685] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:37:25.319203 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:25.319807 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:25.328655 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:25.329549 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:25.330330 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:25.330946 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:25.513221 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:25.521780 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:25.523333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:25.524936 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-068440fa-09dc-45a4-a1ab-5f9ddc570927 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.210008 Feb 28 10:37:25.525500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 364/686] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:25 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:26.242032 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9fc085e7-c3ce-4f48-8b67-eb211e5a8942 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:26.242755 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9fc085e7-c3ce-4f48-8b67-eb211e5a8942 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:26.249891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9fc085e7-c3ce-4f48-8b67-eb211e5a8942 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:26.250334 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9fc085e7-c3ce-4f48-8b67-eb211e5a8942 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:26.251169 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9fc085e7-c3ce-4f48-8b67-eb211e5a8942 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:26.251602 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9fc085e7-c3ce-4f48-8b67-eb211e5a8942 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:26.434023 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9fc085e7-c3ce-4f48-8b67-eb211e5a8942 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:26.450175 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9fc085e7-c3ce-4f48-8b67-eb211e5a8942 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.204684 Feb 28 10:37:26.451423 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 323/687] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:26 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:26.548511 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:26.549179 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:26.557212 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:26.557675 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:26.559208 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:26.560096 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:26.727914 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:26.736194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:26.737711 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:26.738981 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-11fd7597-1b79-4673-84b5-3d30ef2947a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.198712 Feb 28 10:37:26.739537 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 365/688] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:26 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:27.467595 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-dee4b498-afdc-4395-b1d4-197eb5278db7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:27.474083 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-dee4b498-afdc-4395-b1d4-197eb5278db7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:27.483346 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dee4b498-afdc-4395-b1d4-197eb5278db7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:27.484558 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dee4b498-afdc-4395-b1d4-197eb5278db7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:27.485512 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dee4b498-afdc-4395-b1d4-197eb5278db7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:27.486128 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dee4b498-afdc-4395-b1d4-197eb5278db7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:27.655613 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-bd1c884f-bc27-48c2-a583-f6a5d8ae88be tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:27.656184 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-bd1c884f-bc27-48c2-a583-f6a5d8ae88be tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:27.662893 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bd1c884f-bc27-48c2-a583-f6a5d8ae88be tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:27.663532 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bd1c884f-bc27-48c2-a583-f6a5d8ae88be tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:27.664675 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bd1c884f-bc27-48c2-a583-f6a5d8ae88be tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:27.665887 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bd1c884f-bc27-48c2-a583-f6a5d8ae88be tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:27.681341 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-bd1c884f-bc27-48c2-a583-f6a5d8ae88be tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] HTTP exception thrown: Instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe could not be found. Feb 28 10:37:27.682786 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-bd1c884f-bc27-48c2-a583-f6a5d8ae88be tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Returning 404 to user: Instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:37:27.685167 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-bd1c884f-bc27-48c2-a583-f6a5d8ae88be tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 404 len: 111 microversion: 2.1 time: 0.034883 Feb 28 10:37:27.690441 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 366/689] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:37:27 2022] DELETE /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:27.691873 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-dee4b498-afdc-4395-b1d4-197eb5278db7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:27.699944 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-549b64e1-b327-42ac-b87b-9227a7a6dd89 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:27.700889 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-549b64e1-b327-42ac-b87b-9227a7a6dd89 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: ad6d17ae-b508-4ec1-a450-1f325d00cbfe] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:27.705912 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-dee4b498-afdc-4395-b1d4-197eb5278db7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.242293 Feb 28 10:37:27.708491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-549b64e1-b327-42ac-b87b-9227a7a6dd89 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:27.709306 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-549b64e1-b327-42ac-b87b-9227a7a6dd89 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:27.710798 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-549b64e1-b327-42ac-b87b-9227a7a6dd89 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:27.711395 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-549b64e1-b327-42ac-b87b-9227a7a6dd89 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:27.715863 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 324/690] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:27 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:27.726402 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-549b64e1-b327-42ac-b87b-9227a7a6dd89 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] HTTP exception thrown: Instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe could not be found. Feb 28 10:37:27.727043 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-549b64e1-b327-42ac-b87b-9227a7a6dd89 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Returning 404 to user: Instance ad6d17ae-b508-4ec1-a450-1f325d00cbfe could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:37:27.727885 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-549b64e1-b327-42ac-b87b-9227a7a6dd89 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe" status: 404 len: 111 microversion: 2.1 time: 0.035231 Feb 28 10:37:27.728435 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 367/691] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:27 2022] GET /compute/v2.1/servers/ad6d17ae-b508-4ec1-a450-1f325d00cbfe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:27.758105 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:27.758844 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:27.766752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:27.768262 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:27.769908 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:27.770809 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:27.945107 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:27.955735 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:27.957500 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:27.958882 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d7718ea2-2224-4f4e-a323-a8286c93e44a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.204822 Feb 28 10:37:27.970210 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 325/692] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:27 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:37:28.723250 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f5486b81-ec57-46bf-bd10-7bbc29429892 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:28.724073 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f5486b81-ec57-46bf-bd10-7bbc29429892 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:28.731707 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f5486b81-ec57-46bf-bd10-7bbc29429892 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:28.732256 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f5486b81-ec57-46bf-bd10-7bbc29429892 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:28.733061 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f5486b81-ec57-46bf-bd10-7bbc29429892 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:28.733496 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f5486b81-ec57-46bf-bd10-7bbc29429892 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:28.883805 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f5486b81-ec57-46bf-bd10-7bbc29429892 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:28.903944 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f5486b81-ec57-46bf-bd10-7bbc29429892 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.184928 Feb 28 10:37:28.911058 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 368/693] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:28 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:28.930448 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0e8446f2-ead5-4d5c-b2d7-7d15da5fb3c4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:28.930448 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0e8446f2-ead5-4d5c-b2d7-7d15da5fb3c4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:28.935800 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0e8446f2-ead5-4d5c-b2d7-7d15da5fb3c4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:28.936283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0e8446f2-ead5-4d5c-b2d7-7d15da5fb3c4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:28.937135 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0e8446f2-ead5-4d5c-b2d7-7d15da5fb3c4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:28.937717 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0e8446f2-ead5-4d5c-b2d7-7d15da5fb3c4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:28.952773 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-0e8446f2-ead5-4d5c-b2d7-7d15da5fb3c4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] HTTP exception thrown: Instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec could not be found. Feb 28 10:37:28.953521 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0e8446f2-ead5-4d5c-b2d7-7d15da5fb3c4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Returning 404 to user: Instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:37:28.954363 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0e8446f2-ead5-4d5c-b2d7-7d15da5fb3c4 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "DELETE /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 404 len: 111 microversion: 2.1 time: 0.032708 Feb 28 10:37:28.955299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 326/694] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:37:28 2022] DELETE /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:28.963191 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d72b7536-1a78-4dd6-9f4d-e6714e4736e7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:28.963812 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d72b7536-1a78-4dd6-9f4d-e6714e4736e7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] [instance: eeb676a4-94b3-4550-8eb3-b12a16f6f3ec] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:28.970748 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d72b7536-1a78-4dd6-9f4d-e6714e4736e7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:28.971319 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d72b7536-1a78-4dd6-9f4d-e6714e4736e7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:28.972194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d72b7536-1a78-4dd6-9f4d-e6714e4736e7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:28.972712 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d72b7536-1a78-4dd6-9f4d-e6714e4736e7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:28.982298 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:28.983284 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:28.991389 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:28.991847 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:28.992135 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-d72b7536-1a78-4dd6-9f4d-e6714e4736e7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] HTTP exception thrown: Instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec could not be found. Feb 28 10:37:28.992644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:28.992755 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d72b7536-1a78-4dd6-9f4d-e6714e4736e7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] Returning 404 to user: Instance eeb676a4-94b3-4550-8eb3-b12a16f6f3ec could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:37:28.993081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:28.993549 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d72b7536-1a78-4dd6-9f4d-e6714e4736e7 tempest-AttachVolumeTestJSON-721625732 tempest-AttachVolumeTestJSON-721625732-project] 10.222.0.21 "GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec" status: 404 len: 111 microversion: 2.1 time: 0.034361 Feb 28 10:37:28.994113 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 369/695] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:28 2022] GET /compute/v2.1/servers/eeb676a4-94b3-4550-8eb3-b12a16f6f3ec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:29.135844 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-5bf8e47a-7f17-47aa-b531-33e9da014b2c req-deeb53fe-c023-4fe4-9873-9cdabd3cf97e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1357a1-2e5f-4972-91cc-f16f95ebeb23", "name": "network-vif-plugged", "status": "completed", "tag": "529b48cb-8201-4cd7-9a2e-93e7994b3a10"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:29.159966 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-5bf8e47a-7f17-47aa-b531-33e9da014b2c req-deeb53fe-c023-4fe4-9873-9cdabd3cf97e service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:29.171249 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-5bf8e47a-7f17-47aa-b531-33e9da014b2c req-deeb53fe-c023-4fe4-9873-9cdabd3cf97e service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:29.197489 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-5bf8e47a-7f17-47aa-b531-33e9da014b2c req-deeb53fe-c023-4fe4-9873-9cdabd3cf97e service nova] Creating event network-vif-plugged:529b48cb-8201-4cd7-9a2e-93e7994b3a10 for instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 on hv-cinder-maste Feb 28 10:37:29.204624 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-5bf8e47a-7f17-47aa-b531-33e9da014b2c req-deeb53fe-c023-4fe4-9873-9cdabd3cf97e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077638 Feb 28 10:37:29.206492 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 370/696] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:29.230876 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:29.240763 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:29.242759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:29.244646 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c1128724-bbf1-4670-a2bf-47c9f5a9d8cc tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.267113 Feb 28 10:37:29.257529 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 327/697] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:28 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:37:29.923408 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-403af62d-8891-434f-97e3-65b6bb9eb102 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:29.924797 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-403af62d-8891-434f-97e3-65b6bb9eb102 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:29.931378 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-403af62d-8891-434f-97e3-65b6bb9eb102 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:29.932121 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-403af62d-8891-434f-97e3-65b6bb9eb102 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:29.933544 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-403af62d-8891-434f-97e3-65b6bb9eb102 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:29.934272 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-403af62d-8891-434f-97e3-65b6bb9eb102 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:30.106280 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-403af62d-8891-434f-97e3-65b6bb9eb102 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:30.118169 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-403af62d-8891-434f-97e3-65b6bb9eb102 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1267 microversion: 2.1 time: 0.201987 Feb 28 10:37:30.128669 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 371/698] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:29 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:30.264448 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:30.265959 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:30.273644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:30.274483 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:30.275597 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:30.276378 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:30.436677 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:30.452819 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:30.457034 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:30.459340 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-04c5277d-250b-413b-9ece-3b4976190c40 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1037844897"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:30.460146 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-04c5277d-250b-413b-9ece-3b4976190c40 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:30.461598 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5371f016-c0d9-453f-8404-4beae682e758 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.201748 Feb 28 10:37:30.474510 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 328/699] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:30 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:30.485064 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-04c5277d-250b-413b-9ece-3b4976190c40 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:30.485974 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-04c5277d-250b-413b-9ece-3b4976190c40 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:30.487024 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-04c5277d-250b-413b-9ece-3b4976190c40 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:30.487678 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-04c5277d-250b-413b-9ece-3b4976190c40 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:30.729998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.network.security_group_api [None req-04c5277d-250b-413b-9ece-3b4976190c40 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Removing security group bbfa3633-89c5-455a-832d-166fe5a33587 from port 4b9ee076-d1ee-4590-80a3-6e8e06acb5ce Feb 28 10:37:31.136270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6a188fc2-9efa-452a-aebd-0a5b64ffb6f0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:31.137067 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6a188fc2-9efa-452a-aebd-0a5b64ffb6f0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:31.150980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a188fc2-9efa-452a-aebd-0a5b64ffb6f0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:31.151433 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a188fc2-9efa-452a-aebd-0a5b64ffb6f0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:31.152340 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a188fc2-9efa-452a-aebd-0a5b64ffb6f0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:31.152922 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a188fc2-9efa-452a-aebd-0a5b64ffb6f0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:31.289738 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-04c5277d-250b-413b-9ece-3b4976190c40 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "POST /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/action" status: 202 len: 0 microversion: 2.1 time: 0.834787 Feb 28 10:37:31.291754 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 372/700] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:37:30 2022] POST /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/action => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:37:31.455267 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-523216b7-a0eb-4e82-9568-8fad098d6624 req-1c154aad-5b7e-4b5a-89b4-c1d43987dde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1e2144-30f4-491e-a85f-59b429f9879b", "tag": "4b9ee076-d1ee-4590-80a3-6e8e06acb5ce"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:31.469097 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-523216b7-a0eb-4e82-9568-8fad098d6624 req-1c154aad-5b7e-4b5a-89b4-c1d43987dde8 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:31.472650 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-523216b7-a0eb-4e82-9568-8fad098d6624 req-1c154aad-5b7e-4b5a-89b4-c1d43987dde8 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:31.518900 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-523216b7-a0eb-4e82-9568-8fad098d6624 req-1c154aad-5b7e-4b5a-89b4-c1d43987dde8 service nova] Creating event network-changed:4b9ee076-d1ee-4590-80a3-6e8e06acb5ce for instance ba1e2144-30f4-491e-a85f-59b429f9879b on hv-cinder-maste Feb 28 10:37:31.531862 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-523216b7-a0eb-4e82-9568-8fad098d6624 req-1c154aad-5b7e-4b5a-89b4-c1d43987dde8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220711 Feb 28 10:37:31.535717 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 373/701] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:31.551524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-19d70eb8-343e-4c09-b86b-4a316595d41a tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:31.555707 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-19d70eb8-343e-4c09-b86b-4a316595d41a tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:31.582800 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-19d70eb8-343e-4c09-b86b-4a316595d41a tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:31.584632 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-19d70eb8-343e-4c09-b86b-4a316595d41a tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:31.586902 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-19d70eb8-343e-4c09-b86b-4a316595d41a tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:31.591524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-19d70eb8-343e-4c09-b86b-4a316595d41a tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:31.627819 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6a188fc2-9efa-452a-aebd-0a5b64ffb6f0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:31.634630 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-19d70eb8-343e-4c09-b86b-4a316595d41a tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lazy-loading 'flavor' on Instance uuid 6f6a8a33-e76e-450b-a94a-a0852fc6472c {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:37:31.636970 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6a188fc2-9efa-452a-aebd-0a5b64ffb6f0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1454 microversion: 2.1 time: 0.503853 Feb 28 10:37:31.644100 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 329/702] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:31 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1454 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:31.656329 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:31.661996 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:31.681975 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:31.686499 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:31.687686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:31.688334 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:31.759867 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-19d70eb8-343e-4c09-b86b-4a316595d41a tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "POST /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c/action" status: 202 len: 0 microversion: 2.1 time: 0.222484 Feb 28 10:37:31.760468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 374/703] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:37:31 2022] POST /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:37:31.788139 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7cef0ab5-df59-4bf0-bf1d-cb5743430601 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:31.791732 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7cef0ab5-df59-4bf0-bf1d-cb5743430601 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:31.809631 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7cef0ab5-df59-4bf0-bf1d-cb5743430601 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:31.811354 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7cef0ab5-df59-4bf0-bf1d-cb5743430601 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:31.812504 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7cef0ab5-df59-4bf0-bf1d-cb5743430601 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:31.815803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7cef0ab5-df59-4bf0-bf1d-cb5743430601 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:32.076865 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:32.100908 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:32.103166 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:32.104572 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ddc8e3d9-c87e-4bed-ad09-3bf34fa0cd2d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.459293 Feb 28 10:37:32.106027 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 330/704] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:31 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:32.111315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b7fa4752-dbad-45a7-9f71-8cdbb90ad16b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:32.112116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b7fa4752-dbad-45a7-9f71-8cdbb90ad16b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:32.125995 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b7fa4752-dbad-45a7-9f71-8cdbb90ad16b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:32.126713 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b7fa4752-dbad-45a7-9f71-8cdbb90ad16b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:32.127828 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b7fa4752-dbad-45a7-9f71-8cdbb90ad16b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:32.128416 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b7fa4752-dbad-45a7-9f71-8cdbb90ad16b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:32.190996 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7cef0ab5-df59-4bf0-bf1d-cb5743430601 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:32.203402 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7cef0ab5-df59-4bf0-bf1d-cb5743430601 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1454 microversion: 2.1 time: 0.433644 Feb 28 10:37:32.212768 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 375/705] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:31 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1454 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:32.569305 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b7fa4752-dbad-45a7-9f71-8cdbb90ad16b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:32.580322 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b7fa4752-dbad-45a7-9f71-8cdbb90ad16b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.473027 Feb 28 10:37:32.582442 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 331/706] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:32 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:33.125177 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:33.126060 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:33.142203 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:33.143164 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:33.144904 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:33.145563 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:33.536471 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:33.549154 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:33.550805 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:33.556855 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-216b308c-b48f-4306-862e-eeabd67f6470 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.432461 Feb 28 10:37:33.556855 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 376/707] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:33 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:33.600656 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-29b354d9-a6da-4683-849c-14d8277cb984 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:33.601368 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-29b354d9-a6da-4683-849c-14d8277cb984 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:33.609444 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-29b354d9-a6da-4683-849c-14d8277cb984 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:33.610037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-29b354d9-a6da-4683-849c-14d8277cb984 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:33.611387 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-29b354d9-a6da-4683-849c-14d8277cb984 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:33.611950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-29b354d9-a6da-4683-849c-14d8277cb984 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:34.299351 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-29b354d9-a6da-4683-849c-14d8277cb984 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:34.307040 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-29b354d9-a6da-4683-849c-14d8277cb984 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.711277 Feb 28 10:37:34.307475 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 332/708] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:33 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:34.551028 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6f01e408-67f9-4d5a-89ac-ddeab5694de3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:34.552851 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6f01e408-67f9-4d5a-89ac-ddeab5694de3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:34.567643 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6f01e408-67f9-4d5a-89ac-ddeab5694de3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:34.568098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6f01e408-67f9-4d5a-89ac-ddeab5694de3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:34.568909 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6f01e408-67f9-4d5a-89ac-ddeab5694de3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:34.569804 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6f01e408-67f9-4d5a-89ac-ddeab5694de3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:34.581753 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:34.582372 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:34.594151 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:34.594705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:34.595416 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:34.595855 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:34.814647 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-6f01e408-67f9-4d5a-89ac-ddeab5694de3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lazy-loading 'services' on Instance uuid ba1e2144-30f4-491e-a85f-59b429f9879b {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:37:34.945410 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6f01e408-67f9-4d5a-89ac-ddeab5694de3 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments/31e74ecf-1eae-4686-847c-f02b1117e44f" status: 202 len: 0 microversion: 2.1 time: 0.398487 Feb 28 10:37:34.946302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 377/709] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:37:34 2022] DELETE /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments/31e74ecf-1eae-4686-847c-f02b1117e44f => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:37:34.965738 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-b22f49a3-acd1-441f-ab98-284aea6cbcdb req-1b07c3d3-e2ce-447f-bd42-3ecb682ca5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1e2144-30f4-491e-a85f-59b429f9879b", "tag": "4b9ee076-d1ee-4590-80a3-6e8e06acb5ce"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:34.978403 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-b22f49a3-acd1-441f-ab98-284aea6cbcdb req-1b07c3d3-e2ce-447f-bd42-3ecb682ca5ef service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:34.979170 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-b22f49a3-acd1-441f-ab98-284aea6cbcdb req-1b07c3d3-e2ce-447f-bd42-3ecb682ca5ef service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:34.992915 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-b22f49a3-acd1-441f-ab98-284aea6cbcdb req-1b07c3d3-e2ce-447f-bd42-3ecb682ca5ef service nova] Creating event network-changed:4b9ee076-d1ee-4590-80a3-6e8e06acb5ce for instance ba1e2144-30f4-491e-a85f-59b429f9879b on hv-cinder-maste Feb 28 10:37:34.998988 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:35.009178 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:35.012045 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-b22f49a3-acd1-441f-ab98-284aea6cbcdb req-1b07c3d3-e2ce-447f-bd42-3ecb682ca5ef service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063563 Feb 28 10:37:35.012872 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 378/710] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:35.015322 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:35.016860 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6f74440f-b29c-479f-82b1-5ce0dcdf9a4b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1741 microversion: 2.20 time: 0.438974 Feb 28 10:37:35.018366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d89152ef-4ace-47f4-8d48-2e58fcd05030 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:35.019767 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d89152ef-4ace-47f4-8d48-2e58fcd05030 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:35.027153 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d89152ef-4ace-47f4-8d48-2e58fcd05030 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:35.027833 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d89152ef-4ace-47f4-8d48-2e58fcd05030 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:35.028880 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d89152ef-4ace-47f4-8d48-2e58fcd05030 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:35.029493 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d89152ef-4ace-47f4-8d48-2e58fcd05030 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:35.038748 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 333/711] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:34 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1741 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:35.080277 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d89152ef-4ace-47f4-8d48-2e58fcd05030 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065855 Feb 28 10:37:35.081491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 379/712] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:37:35 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:35.324621 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-61e19457-cc97-4a03-8196-4449f6d7aca2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:35.325369 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-61e19457-cc97-4a03-8196-4449f6d7aca2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:35.335350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-61e19457-cc97-4a03-8196-4449f6d7aca2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:35.336187 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-61e19457-cc97-4a03-8196-4449f6d7aca2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:35.337464 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-61e19457-cc97-4a03-8196-4449f6d7aca2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:35.338864 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-61e19457-cc97-4a03-8196-4449f6d7aca2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:35.717697 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-61e19457-cc97-4a03-8196-4449f6d7aca2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:35.735039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-61e19457-cc97-4a03-8196-4449f6d7aca2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.414304 Feb 28 10:37:35.750101 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 334/713] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:35 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:36.054189 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:36.055432 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:36.066442 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:36.067884 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:36.068914 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:36.069793 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:36.093214 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7403fbbe-1ec3-4586-81a5-1365c5cf219b tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:36.094468 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7403fbbe-1ec3-4586-81a5-1365c5cf219b tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:36.102207 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7403fbbe-1ec3-4586-81a5-1365c5cf219b tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:36.103169 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7403fbbe-1ec3-4586-81a5-1365c5cf219b tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:36.104197 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7403fbbe-1ec3-4586-81a5-1365c5cf219b tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:36.104783 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7403fbbe-1ec3-4586-81a5-1365c5cf219b tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:36.162414 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7403fbbe-1ec3-4586-81a5-1365c5cf219b tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073393 Feb 28 10:37:36.163485 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 335/714] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:37:36 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:36.379225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-61e530c4-7b83-4490-abc1-d947e0b43b5c req-aabf2985-77a4-4c8b-a255-61f8b15af9de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1357a1-2e5f-4972-91cc-f16f95ebeb23", "tag": "529b48cb-8201-4cd7-9a2e-93e7994b3a10"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:36.390291 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-61e530c4-7b83-4490-abc1-d947e0b43b5c req-aabf2985-77a4-4c8b-a255-61f8b15af9de service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:36.391045 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-61e530c4-7b83-4490-abc1-d947e0b43b5c req-aabf2985-77a4-4c8b-a255-61f8b15af9de service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:36.406726 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-61e530c4-7b83-4490-abc1-d947e0b43b5c req-aabf2985-77a4-4c8b-a255-61f8b15af9de service nova] Creating event network-changed:529b48cb-8201-4cd7-9a2e-93e7994b3a10 for instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 on hv-cinder-maste Feb 28 10:37:36.416523 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-61e530c4-7b83-4490-abc1-d947e0b43b5c req-aabf2985-77a4-4c8b-a255-61f8b15af9de service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041576 Feb 28 10:37:36.418880 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 336/715] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:36.474977 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:36.486457 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:36.489515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:36.490900 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a94e6e89-012e-4a76-95b9-e0868c4952e9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1723 microversion: 2.20 time: 0.450202 Feb 28 10:37:36.492334 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 380/716] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:36 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1723 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:36.753491 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2871f5f7-3780-480a-b2e0-84b081b60ca0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:36.754196 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2871f5f7-3780-480a-b2e0-84b081b60ca0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:36.771824 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2871f5f7-3780-480a-b2e0-84b081b60ca0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:36.772325 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2871f5f7-3780-480a-b2e0-84b081b60ca0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:36.773329 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2871f5f7-3780-480a-b2e0-84b081b60ca0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:36.776482 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2871f5f7-3780-480a-b2e0-84b081b60ca0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:37.003530 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2871f5f7-3780-480a-b2e0-84b081b60ca0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:37.012069 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2871f5f7-3780-480a-b2e0-84b081b60ca0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.262509 Feb 28 10:37:37.022582 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 337/717] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:36 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:37.173570 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a448a3ce-e868-4612-83d0-7d111b9c85e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:37.174513 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a448a3ce-e868-4612-83d0-7d111b9c85e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:37.181794 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a448a3ce-e868-4612-83d0-7d111b9c85e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:37.182506 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a448a3ce-e868-4612-83d0-7d111b9c85e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:37.183551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a448a3ce-e868-4612-83d0-7d111b9c85e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:37.184184 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a448a3ce-e868-4612-83d0-7d111b9c85e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:37.215511 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a448a3ce-e868-4612-83d0-7d111b9c85e1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045294 Feb 28 10:37:37.221503 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 381/718] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:37:37 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 10:37:37.227519 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-97ab3539-f55f-4e88-9fa4-150408599efa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:37.228657 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-97ab3539-f55f-4e88-9fa4-150408599efa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:37.235380 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-97ab3539-f55f-4e88-9fa4-150408599efa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:37.235643 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-97ab3539-f55f-4e88-9fa4-150408599efa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:37.236502 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-97ab3539-f55f-4e88-9fa4-150408599efa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:37.237330 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-97ab3539-f55f-4e88-9fa4-150408599efa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:37.316989 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-97ab3539-f55f-4e88-9fa4-150408599efa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] HTTP exception thrown: Instance ba1e2144-30f4-491e-a85f-59b429f9879b is not attached to volume 31e74ecf-1eae-4686-847c-f02b1117e44f Feb 28 10:37:37.317703 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-97ab3539-f55f-4e88-9fa4-150408599efa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Returning 404 to user: Instance ba1e2144-30f4-491e-a85f-59b429f9879b is not attached to volume 31e74ecf-1eae-4686-847c-f02b1117e44f {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:37:37.318660 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-97ab3539-f55f-4e88-9fa4-150408599efa tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments/31e74ecf-1eae-4686-847c-f02b1117e44f" status: 404 len: 154 microversion: 2.1 time: 0.095459 Feb 28 10:37:37.322569 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 338/719] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:37:37 2022] DELETE /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b/os-volume_attachments/31e74ecf-1eae-4686-847c-f02b1117e44f => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:37.510239 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:37.510894 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:37.517453 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:37.517899 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:37.518712 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:37.519147 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:37.687181 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:37.698262 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:37.701524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:37.703236 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1c719331-3089-4faa-b03d-6084542fd1e5 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1723 microversion: 2.20 time: 0.196742 Feb 28 10:37:37.704150 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 382/720] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:37 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:38.029742 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-287d3df5-1fec-4d6b-8906-06cec38b4f0b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:38.030357 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-287d3df5-1fec-4d6b-8906-06cec38b4f0b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:38.036616 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-287d3df5-1fec-4d6b-8906-06cec38b4f0b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:38.037065 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-287d3df5-1fec-4d6b-8906-06cec38b4f0b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:38.037854 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-287d3df5-1fec-4d6b-8906-06cec38b4f0b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:38.038290 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-287d3df5-1fec-4d6b-8906-06cec38b4f0b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:38.244658 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-287d3df5-1fec-4d6b-8906-06cec38b4f0b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:38.253368 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-287d3df5-1fec-4d6b-8906-06cec38b4f0b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.227825 Feb 28 10:37:38.257707 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 339/721] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:38 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:38.470268 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2ff29d32-f722-452a-b5c8-7d39800b91f9 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:38.470992 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2ff29d32-f722-452a-b5c8-7d39800b91f9 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:38.478349 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2ff29d32-f722-452a-b5c8-7d39800b91f9 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:38.479401 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2ff29d32-f722-452a-b5c8-7d39800b91f9 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:38.481422 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2ff29d32-f722-452a-b5c8-7d39800b91f9 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:38.482224 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2ff29d32-f722-452a-b5c8-7d39800b91f9 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:38.517251 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2ff29d32-f722-452a-b5c8-7d39800b91f9 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Going to try to terminate instance {{(pid=123151) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:37:38.521087 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-940082188", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "networks": [{"uuid": "385c32c8-9d90-44b6-bcc3-678e48a38bb6"}]}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:38.575768 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.network.neutron [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] validate_networks() for [('385c32c8-9d90-44b6-bcc3-678e48a38bb6', None, None, None, None, None)] {{(pid=123152) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:37:38.603114 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2ff29d32-f722-452a-b5c8-7d39800b91f9 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 204 len: 0 microversion: 2.1 time: 0.140334 Feb 28 10:37:38.604002 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 340/722] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:37:38 2022] DELETE /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:37:38.612595 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-cb5a4fc4-3bbd-4f10-a667-c83c2cffd6a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:38.613314 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-cb5a4fc4-3bbd-4f10-a667-c83c2cffd6a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:38.619912 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cb5a4fc4-3bbd-4f10-a667-c83c2cffd6a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:38.620362 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cb5a4fc4-3bbd-4f10-a667-c83c2cffd6a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:38.621191 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cb5a4fc4-3bbd-4f10-a667-c83c2cffd6a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:38.621899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cb5a4fc4-3bbd-4f10-a667-c83c2cffd6a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:38.830897 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-cb5a4fc4-3bbd-4f10-a667-c83c2cffd6a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:38.838756 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-cb5a4fc4-3bbd-4f10-a667-c83c2cffd6a8 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1552 microversion: 2.1 time: 0.230244 Feb 28 10:37:38.839158 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 341/723] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:38 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:38.844684 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:38.845291 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:38.852008 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:38.852466 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:38.853253 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:38.854113 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.097580 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:39.108141 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:39.117886 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:39.119433 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b77ad850-e10a-48b2-8744-fef35ce4d582 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1726 microversion: 2.20 time: 0.279247 Feb 28 10:37:39.120453 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 342/724] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:38 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1726 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:39.129191 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-402d1be0-264b-4137-996b-9a9a43788560 req-73a290e7-467f-442a-83c0-1368401902b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d16ba15-2ef6-4ce9-a9cd-d5e14657271a", "name": "network-vif-unplugged", "status": "completed", "tag": "c091db1b-3683-4633-8290-5a1701243cc7"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:39.139202 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-402d1be0-264b-4137-996b-9a9a43788560 req-73a290e7-467f-442a-83c0-1368401902b3 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.139648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-402d1be0-264b-4137-996b-9a9a43788560 req-73a290e7-467f-442a-83c0-1368401902b3 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.140548 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Flavor limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:37:39.141009 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Image limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:37:39.141666 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Flavor pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:37:39.142077 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Image pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:37:39.142486 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:37:39.152497 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.compute.server_external_events [req-402d1be0-264b-4137-996b-9a9a43788560 req-73a290e7-467f-442a-83c0-1368401902b3 service nova] Unable to find a host for instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a. Dropping event network-vif-unplugged {{(pid=123151) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Feb 28 10:37:39.153748 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-402d1be0-264b-4137-996b-9a9a43788560 req-73a290e7-467f-442a-83c0-1368401902b3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032760 Feb 28 10:37:39.153951 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.154673 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.155032 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 343/725] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 28 10:37:39.155896 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.156327 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.159877 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-1a378dcc-4e07-4625-93f4-33defdd1781f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "011452b0-9ed5-4a5a-b078-1827a2bc1d05"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:39.160909 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-1a378dcc-4e07-4625-93f4-33defdd1781f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:39.168467 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a378dcc-4e07-4625-93f4-33defdd1781f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.168927 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a378dcc-4e07-4625-93f4-33defdd1781f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.169725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a378dcc-4e07-4625-93f4-33defdd1781f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.170162 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a378dcc-4e07-4625-93f4-33defdd1781f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.174772 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Getting quotas for project 5c79b1decd974ef2bb73bf55edc02f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:37:39.178762 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Getting quotas for user 3cdcba6d332b492196494db46ced8b9f and project 5c79b1decd974ef2bb73bf55edc02f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:37:39.189938 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Going to run 1 instances... {{(pid=123152) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:37:39.192227 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:37:39.238795 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-bed4c800-b5f2-4420-aa07-6090c9f2a124 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846986 Feb 28 10:37:39.239672 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 383/726] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:37:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:37:39.250311 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ee4ed0d3-d781-4379-b5b4-1a441a898de6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:39.251172 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ee4ed0d3-d781-4379-b5b4-1a441a898de6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:39.475554 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-1a378dcc-4e07-4625-93f4-33defdd1781f tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319435 Feb 28 10:37:39.477201 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 344/727] 10.222.0.21 () {62 vars in 1363 bytes} [Mon Feb 28 10:37:39 2022] POST /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 10:37:39.500843 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-efa64467-29a2-4851-b7cf-cd5600d5ecbb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:39.501629 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-efa64467-29a2-4851-b7cf-cd5600d5ecbb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:39.508769 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-efa64467-29a2-4851-b7cf-cd5600d5ecbb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.509439 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-efa64467-29a2-4851-b7cf-cd5600d5ecbb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.510367 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-efa64467-29a2-4851-b7cf-cd5600d5ecbb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.510928 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-efa64467-29a2-4851-b7cf-cd5600d5ecbb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.586188 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ee4ed0d3-d781-4379-b5b4-1a441a898de6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:39.594505 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ee4ed0d3-d781-4379-b5b4-1a441a898de6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1217 microversion: 2.1 time: 0.348741 Feb 28 10:37:39.598910 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 384/728] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:39 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:39.613476 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b3523f07-232f-46db-8103-9058e082b128 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:39.613476 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b3523f07-232f-46db-8103-9058e082b128 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:39.619122 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b3523f07-232f-46db-8103-9058e082b128 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.619646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b3523f07-232f-46db-8103-9058e082b128 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.620515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b3523f07-232f-46db-8103-9058e082b128 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.621235 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b3523f07-232f-46db-8103-9058e082b128 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.731648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-efa64467-29a2-4851-b7cf-cd5600d5ecbb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:39.739982 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-efa64467-29a2-4851-b7cf-cd5600d5ecbb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.261302 Feb 28 10:37:39.740486 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 345/729] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:39 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:39.857815 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-73f949be-bdb7-4d06-ad68-18a6f5fcd11a tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:39.858547 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-73f949be-bdb7-4d06-ad68-18a6f5fcd11a tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:39.864660 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-73f949be-bdb7-4d06-ad68-18a6f5fcd11a tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.865306 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-73f949be-bdb7-4d06-ad68-18a6f5fcd11a tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.866093 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-73f949be-bdb7-4d06-ad68-18a6f5fcd11a tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.866534 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-73f949be-bdb7-4d06-ad68-18a6f5fcd11a tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.925353 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b3523f07-232f-46db-8103-9058e082b128 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/os-volume_attachments/011452b0-9ed5-4a5a-b078-1827a2bc1d05" status: 202 len: 0 microversion: 2.20 time: 0.317350 Feb 28 10:37:39.926351 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 385/730] 10.222.0.21 () {60 vars in 1456 bytes} [Mon Feb 28 10:37:39 2022] DELETE /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/os-volume_attachments/011452b0-9ed5-4a5a-b078-1827a2bc1d05 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 28 10:37:39.989380 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c1afa918-7e25-4c63-9093-12924dc6aa92 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:39.989946 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c1afa918-7e25-4c63-9093-12924dc6aa92 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:39.998151 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1afa918-7e25-4c63-9093-12924dc6aa92 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.998587 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1afa918-7e25-4c63-9093-12924dc6aa92 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:39.999414 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1afa918-7e25-4c63-9093-12924dc6aa92 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:39.999846 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c1afa918-7e25-4c63-9093-12924dc6aa92 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:40.014095 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-73f949be-bdb7-4d06-ad68-18a6f5fcd11a tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:40.021427 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-73f949be-bdb7-4d06-ad68-18a6f5fcd11a tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1552 microversion: 2.1 time: 0.168120 Feb 28 10:37:40.021995 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 346/731] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:39 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:40.078781 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c1afa918-7e25-4c63-9093-12924dc6aa92 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "POST /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/action" status: 202 len: 0 microversion: 2.20 time: 0.093461 Feb 28 10:37:40.079392 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 386/732] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Feb 28 10:37:39 2022] POST /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 28 10:37:40.087562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:40.088184 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:40.096720 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:40.097172 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:40.097962 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:40.098429 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:40.245016 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:40.253011 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:40.254632 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:40.255985 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-683f9a89-8809-4fc6-b964-1248b05d6285 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1674 microversion: 2.20 time: 0.172390 Feb 28 10:37:40.256544 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 347/733] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:40 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:40.616021 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7b118915-d201-49fa-bb9b-df64c6f4c76a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:40.617026 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7b118915-d201-49fa-bb9b-df64c6f4c76a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:40.625212 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7b118915-d201-49fa-bb9b-df64c6f4c76a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:40.625893 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7b118915-d201-49fa-bb9b-df64c6f4c76a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:40.626724 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7b118915-d201-49fa-bb9b-df64c6f4c76a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:40.627299 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7b118915-d201-49fa-bb9b-df64c6f4c76a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:40.715907 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7b118915-d201-49fa-bb9b-df64c6f4c76a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:40.724666 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7b118915-d201-49fa-bb9b-df64c6f4c76a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1275 microversion: 2.1 time: 0.115933 Feb 28 10:37:40.725315 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 387/734] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:40 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:40.759304 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-478ec9d7-963b-456b-a0a9-390cf4ade93e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:40.760065 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-478ec9d7-963b-456b-a0a9-390cf4ade93e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:40.768630 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-478ec9d7-963b-456b-a0a9-390cf4ade93e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:40.768630 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-478ec9d7-963b-456b-a0a9-390cf4ade93e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:40.769888 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-478ec9d7-963b-456b-a0a9-390cf4ade93e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:40.770438 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-478ec9d7-963b-456b-a0a9-390cf4ade93e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:40.947575 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-478ec9d7-963b-456b-a0a9-390cf4ade93e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:40.958731 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-478ec9d7-963b-456b-a0a9-390cf4ade93e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.204270 Feb 28 10:37:40.960264 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 348/735] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:40 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:41.039580 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0ede2335-9fc9-4a2c-b2e2-608d3bcd940e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:41.040604 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0ede2335-9fc9-4a2c-b2e2-608d3bcd940e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:41.049292 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ede2335-9fc9-4a2c-b2e2-608d3bcd940e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:41.049775 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ede2335-9fc9-4a2c-b2e2-608d3bcd940e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:41.050824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ede2335-9fc9-4a2c-b2e2-608d3bcd940e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:41.051605 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0ede2335-9fc9-4a2c-b2e2-608d3bcd940e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:41.275599 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:41.276313 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:41.283742 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:41.284649 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:41.285822 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:41.286516 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:41.293528 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0ede2335-9fc9-4a2c-b2e2-608d3bcd940e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e840e28ad3194d7ea995ea2d2b57843e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8784f6a53624f7688d9ae0ae0e15169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:41.309605 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0ede2335-9fc9-4a2c-b2e2-608d3bcd940e tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 200 len: 1552 microversion: 2.1 time: 0.274792 Feb 28 10:37:41.315698 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 388/736] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:41 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 1552 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:41.506167 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:41.515756 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:41.517749 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:41.519338 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3f7c8ade-b10e-4b44-b9c8-8a848ce77fcf tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1676 microversion: 2.20 time: 0.247978 Feb 28 10:37:41.520358 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 349/737] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:41 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1676 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:37:41.608275 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-a8637fbf-f607-4b82-8548-cbba1e5fe3bf req-b95c121b-886e-421b-85cf-01dafb993670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1e2144-30f4-491e-a85f-59b429f9879b", "name": "network-vif-deleted", "tag": "4b9ee076-d1ee-4590-80a3-6e8e06acb5ce"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:41.618523 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-a8637fbf-f607-4b82-8548-cbba1e5fe3bf req-b95c121b-886e-421b-85cf-01dafb993670 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:41.619224 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-a8637fbf-f607-4b82-8548-cbba1e5fe3bf req-b95c121b-886e-421b-85cf-01dafb993670 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:41.633100 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-a8637fbf-f607-4b82-8548-cbba1e5fe3bf req-b95c121b-886e-421b-85cf-01dafb993670 service nova] Creating event network-vif-deleted:4b9ee076-d1ee-4590-80a3-6e8e06acb5ce for instance ba1e2144-30f4-491e-a85f-59b429f9879b on hv-cinder-maste Feb 28 10:37:41.640133 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-a8637fbf-f607-4b82-8548-cbba1e5fe3bf req-b95c121b-886e-421b-85cf-01dafb993670 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036311 Feb 28 10:37:41.644581 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 389/738] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:41.742484 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-465fce06-38f2-477c-8ac3-6ef659ba28d7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:41.743194 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-465fce06-38f2-477c-8ac3-6ef659ba28d7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:41.750398 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-465fce06-38f2-477c-8ac3-6ef659ba28d7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:41.751174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-465fce06-38f2-477c-8ac3-6ef659ba28d7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:41.752374 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-465fce06-38f2-477c-8ac3-6ef659ba28d7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:41.753092 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-465fce06-38f2-477c-8ac3-6ef659ba28d7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:41.977895 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a3aec1a3-f1d3-4dbd-8795-d4c6ba3768cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:41.978631 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a3aec1a3-f1d3-4dbd-8795-d4c6ba3768cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:41.986186 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a3aec1a3-f1d3-4dbd-8795-d4c6ba3768cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:41.986939 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a3aec1a3-f1d3-4dbd-8795-d4c6ba3768cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:41.987903 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a3aec1a3-f1d3-4dbd-8795-d4c6ba3768cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:41.988499 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a3aec1a3-f1d3-4dbd-8795-d4c6ba3768cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:42.003048 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-465fce06-38f2-477c-8ac3-6ef659ba28d7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:42.013590 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-465fce06-38f2-477c-8ac3-6ef659ba28d7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.274307 Feb 28 10:37:42.014618 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 350/739] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:41 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:42.175430 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-e4d2351b-a684-4500-9c8e-ee2a06131320 req-0f68704d-f5db-4f03-a209-3d939b1bbdaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9afa739-da2b-478b-af9a-7ea5ad86650d", "tag": "2df07693-98c8-4c85-a461-d68a9578eb1a"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:42.191109 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-e4d2351b-a684-4500-9c8e-ee2a06131320 req-0f68704d-f5db-4f03-a209-3d939b1bbdaf service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:42.192261 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-e4d2351b-a684-4500-9c8e-ee2a06131320 req-0f68704d-f5db-4f03-a209-3d939b1bbdaf service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:42.204863 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-e4d2351b-a684-4500-9c8e-ee2a06131320 req-0f68704d-f5db-4f03-a209-3d939b1bbdaf service nova] Creating event network-changed:2df07693-98c8-4c85-a461-d68a9578eb1a for instance c9afa739-da2b-478b-af9a-7ea5ad86650d on hv-cinder-maste Feb 28 10:37:42.211733 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-e4d2351b-a684-4500-9c8e-ee2a06131320 req-0f68704d-f5db-4f03-a209-3d939b1bbdaf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046818 Feb 28 10:37:42.212343 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 351/740] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:37:42.328006 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8e640eca-4e6b-4456-a6a7-7545a4139fcb tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:42.329084 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8e640eca-4e6b-4456-a6a7-7545a4139fcb tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] [instance: ba1e2144-30f4-491e-a85f-59b429f9879b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:42.335789 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8e640eca-4e6b-4456-a6a7-7545a4139fcb tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:42.337189 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8e640eca-4e6b-4456-a6a7-7545a4139fcb tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:42.338260 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8e640eca-4e6b-4456-a6a7-7545a4139fcb tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:42.338990 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8e640eca-4e6b-4456-a6a7-7545a4139fcb tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:42.374997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-8e640eca-4e6b-4456-a6a7-7545a4139fcb tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] HTTP exception thrown: Instance ba1e2144-30f4-491e-a85f-59b429f9879b could not be found. Feb 28 10:37:42.375726 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8e640eca-4e6b-4456-a6a7-7545a4139fcb tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Returning 404 to user: Instance ba1e2144-30f4-491e-a85f-59b429f9879b could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:37:42.376651 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8e640eca-4e6b-4456-a6a7-7545a4139fcb tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b" status: 404 len: 111 microversion: 2.1 time: 0.053974 Feb 28 10:37:42.377761 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 352/741] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:42 2022] GET /compute/v2.1/servers/ba1e2144-30f4-491e-a85f-59b429f9879b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:42.380978 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a3aec1a3-f1d3-4dbd-8795-d4c6ba3768cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:42.389250 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ee9e6176-9b27-4cb0-a91e-9071c4eff1b1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] Calling method '.version_select at 0x7f1c5816da60>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:42.392231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a3aec1a3-f1d3-4dbd-8795-d4c6ba3768cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.418569 Feb 28 10:37:42.393304 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 390/742] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:41 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:42.409297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ee9e6176-9b27-4cb0-a91e-9071c4eff1b1 tempest-TestMinimumBasicScenario-977031880 tempest-TestMinimumBasicScenario-977031880-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-377015774" status: 202 len: 0 microversion: 2.1 time: 0.027349 Feb 28 10:37:42.409970 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 353/743] 10.222.0.21 () {58 vars in 1268 bytes} [Mon Feb 28 10:37:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-377015774 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:37:42.546923 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:42.547625 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:42.559256 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:42.561616 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:42.563719 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:42.564383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:43.033515 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-40b0f7d8-2227-4f8e-b61d-0537d3185fd8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:43.035617 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-40b0f7d8-2227-4f8e-b61d-0537d3185fd8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:43.047383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:43.069011 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:43.069666 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-40b0f7d8-2227-4f8e-b61d-0537d3185fd8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:43.072017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-40b0f7d8-2227-4f8e-b61d-0537d3185fd8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:43.074832 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-40b0f7d8-2227-4f8e-b61d-0537d3185fd8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:43.075754 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:43.077779 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-40b0f7d8-2227-4f8e-b61d-0537d3185fd8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:43.078967 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1a81842c-8f17-4e9a-929c-ef9b00fbe938 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.543068 Feb 28 10:37:43.090654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 391/744] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:42 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:43.412026 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-72d21162-aa23-46d1-84b4-ee99b6f38a65 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:43.412978 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-72d21162-aa23-46d1-84b4-ee99b6f38a65 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:43.423801 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72d21162-aa23-46d1-84b4-ee99b6f38a65 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:43.424551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72d21162-aa23-46d1-84b4-ee99b6f38a65 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:43.425523 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72d21162-aa23-46d1-84b4-ee99b6f38a65 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:43.426107 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72d21162-aa23-46d1-84b4-ee99b6f38a65 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:43.469651 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-40b0f7d8-2227-4f8e-b61d-0537d3185fd8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:43.479632 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-40b0f7d8-2227-4f8e-b61d-0537d3185fd8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.450698 Feb 28 10:37:43.480267 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 354/745] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:43 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:43.778808 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-72d21162-aa23-46d1-84b4-ee99b6f38a65 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:43.794952 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-72d21162-aa23-46d1-84b4-ee99b6f38a65 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.384388 Feb 28 10:37:43.796354 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 392/746] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:43 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:44.100040 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:44.100656 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:44.108001 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:44.108460 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:44.109273 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:44.109718 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:44.497872 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-40c3f4a1-e796-47fd-a339-b9ff72ff5e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:44.498627 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-40c3f4a1-e796-47fd-a339-b9ff72ff5e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:44.503254 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:44.504947 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-40c3f4a1-e796-47fd-a339-b9ff72ff5e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:44.505577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-40c3f4a1-e796-47fd-a339-b9ff72ff5e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:44.506454 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-40c3f4a1-e796-47fd-a339-b9ff72ff5e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:44.506926 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-40c3f4a1-e796-47fd-a339-b9ff72ff5e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:44.514334 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:44.516588 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:44.518200 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-61b2b732-6b6a-4e47-b5b2-f3bbe5e85ded tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.422218 Feb 28 10:37:44.531114 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 355/747] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:44 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:44.784106 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-40c3f4a1-e796-47fd-a339-b9ff72ff5e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:44.797020 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-40c3f4a1-e796-47fd-a339-b9ff72ff5e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.302963 Feb 28 10:37:44.797792 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 393/748] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:44 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:44.812706 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c6e80b17-bd99-47f7-9a69-687e20f64a7b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:44.813329 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c6e80b17-bd99-47f7-9a69-687e20f64a7b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:44.824430 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c6e80b17-bd99-47f7-9a69-687e20f64a7b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:44.824876 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c6e80b17-bd99-47f7-9a69-687e20f64a7b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:44.825865 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c6e80b17-bd99-47f7-9a69-687e20f64a7b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:44.826498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c6e80b17-bd99-47f7-9a69-687e20f64a7b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:45.068166 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c6e80b17-bd99-47f7-9a69-687e20f64a7b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:45.076112 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c6e80b17-bd99-47f7-9a69-687e20f64a7b tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.267894 Feb 28 10:37:45.076646 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 356/749] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:44 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:45.537454 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:45.537996 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:45.544036 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:45.544491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:45.545286 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:45.545725 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:45.787090 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:45.797184 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:45.802716 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:45.805154 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1edf34ad-399c-427e-8689-81622b8a593a tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.271605 Feb 28 10:37:45.815056 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-fa5a7f0e-bba9-43d2-9442-e39a03d22e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:45.816345 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-fa5a7f0e-bba9-43d2-9442-e39a03d22e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:45.821993 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 394/750] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:45 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:45.825394 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fa5a7f0e-bba9-43d2-9442-e39a03d22e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:45.826034 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fa5a7f0e-bba9-43d2-9442-e39a03d22e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:45.827242 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fa5a7f0e-bba9-43d2-9442-e39a03d22e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:45.827885 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-fa5a7f0e-bba9-43d2-9442-e39a03d22e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:46.022178 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fa5a7f0e-bba9-43d2-9442-e39a03d22e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:46.031380 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-fa5a7f0e-bba9-43d2-9442-e39a03d22e4c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.220844 Feb 28 10:37:46.032989 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 357/751] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:45 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:46.096942 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2190532a-b132-44e5-b52c-e25c703f6943 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:46.097896 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2190532a-b132-44e5-b52c-e25c703f6943 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:46.104532 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2190532a-b132-44e5-b52c-e25c703f6943 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:46.105524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2190532a-b132-44e5-b52c-e25c703f6943 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:46.106857 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2190532a-b132-44e5-b52c-e25c703f6943 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:46.107460 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2190532a-b132-44e5-b52c-e25c703f6943 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:46.291225 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2190532a-b132-44e5-b52c-e25c703f6943 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:46.301020 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2190532a-b132-44e5-b52c-e25c703f6943 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.210853 Feb 28 10:37:46.302191 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 395/752] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:46 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:46.828383 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:46.828994 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:46.835331 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:46.835784 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:46.836553 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:46.836980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:47.049209 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ae69d18e-fd14-4103-bb4f-62e24add3e0e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:47.050487 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ae69d18e-fd14-4103-bb4f-62e24add3e0e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:47.077168 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ae69d18e-fd14-4103-bb4f-62e24add3e0e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:47.078554 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ae69d18e-fd14-4103-bb4f-62e24add3e0e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:47.079869 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ae69d18e-fd14-4103-bb4f-62e24add3e0e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:47.080491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ae69d18e-fd14-4103-bb4f-62e24add3e0e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:47.102981 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:47.118934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:47.121421 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:47.125352 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-49f14162-da40-4eef-bd65-817ebaddcad1 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.299016 Feb 28 10:37:47.126765 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 358/753] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:46 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:47.320751 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-dbe4bd04-c158-4385-b33f-c7911674a376 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:47.322145 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-dbe4bd04-c158-4385-b33f-c7911674a376 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:47.330740 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dbe4bd04-c158-4385-b33f-c7911674a376 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:47.331454 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dbe4bd04-c158-4385-b33f-c7911674a376 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:47.332815 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dbe4bd04-c158-4385-b33f-c7911674a376 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:47.333439 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dbe4bd04-c158-4385-b33f-c7911674a376 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:47.359606 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ae69d18e-fd14-4103-bb4f-62e24add3e0e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:47.368819 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ae69d18e-fd14-4103-bb4f-62e24add3e0e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.323587 Feb 28 10:37:47.369935 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 396/754] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:47 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:47.630195 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-dbe4bd04-c158-4385-b33f-c7911674a376 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:47.642725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-dbe4bd04-c158-4385-b33f-c7911674a376 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.325163 Feb 28 10:37:47.649235 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 359/755] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:47 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:48.145619 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:48.146749 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:48.159424 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:48.161801 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:48.162637 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:48.163085 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:48.379099 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:48.387383 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0c3226de-d419-4df2-ab4f-6e743afb7ac7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:48.388378 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0c3226de-d419-4df2-ab4f-6e743afb7ac7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:48.388617 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:48.390337 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:48.391684 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-39d4743a-9d88-4b67-abe0-5ba89f702e46 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.251563 Feb 28 10:37:48.392251 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 397/756] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:48 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:37:48.402405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0c3226de-d419-4df2-ab4f-6e743afb7ac7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:48.402405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0c3226de-d419-4df2-ab4f-6e743afb7ac7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:48.402405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0c3226de-d419-4df2-ab4f-6e743afb7ac7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:48.402405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0c3226de-d419-4df2-ab4f-6e743afb7ac7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:48.608722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0c3226de-d419-4df2-ab4f-6e743afb7ac7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:48.616492 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0c3226de-d419-4df2-ab4f-6e743afb7ac7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.234011 Feb 28 10:37:48.617060 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 360/757] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:48 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:48.662739 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a0a15f6f-181a-4470-9438-ae1cff108c5f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:48.663780 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a0a15f6f-181a-4470-9438-ae1cff108c5f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:48.672447 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a0a15f6f-181a-4470-9438-ae1cff108c5f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:48.672902 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a0a15f6f-181a-4470-9438-ae1cff108c5f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:48.673704 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a0a15f6f-181a-4470-9438-ae1cff108c5f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:48.674135 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a0a15f6f-181a-4470-9438-ae1cff108c5f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:48.917324 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a0a15f6f-181a-4470-9438-ae1cff108c5f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:48.925402 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a0a15f6f-181a-4470-9438-ae1cff108c5f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.267580 Feb 28 10:37:48.937351 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 398/758] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:48 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:49.176248 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-b20944e0-0891-4d21-97f3-a11645c537cc req-2322c25a-b698-4f7c-9a0f-b3757e096342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9afa739-da2b-478b-af9a-7ea5ad86650d", "name": "network-vif-plugged", "status": "completed", "tag": "2df07693-98c8-4c85-a461-d68a9578eb1a"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:49.193243 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-b20944e0-0891-4d21-97f3-a11645c537cc req-2322c25a-b698-4f7c-9a0f-b3757e096342 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:49.193669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-b20944e0-0891-4d21-97f3-a11645c537cc req-2322c25a-b698-4f7c-9a0f-b3757e096342 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:49.213699 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-b20944e0-0891-4d21-97f3-a11645c537cc req-2322c25a-b698-4f7c-9a0f-b3757e096342 service nova] Creating event network-vif-plugged:2df07693-98c8-4c85-a461-d68a9578eb1a for instance c9afa739-da2b-478b-af9a-7ea5ad86650d on hv-cinder-maste Feb 28 10:37:49.228633 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-b20944e0-0891-4d21-97f3-a11645c537cc req-2322c25a-b698-4f7c-9a0f-b3757e096342 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056755 Feb 28 10:37:49.230063 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 361/759] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:49.409539 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:49.410123 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:49.416451 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:49.417037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:49.417984 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:49.418491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:49.605701 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:49.614945 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:49.616699 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:49.618619 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d2b34fa9-282c-47bf-9663-210e5a809981 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.212371 Feb 28 10:37:49.625622 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 399/760] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:49 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:49.637037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3d775847-b5e9-4966-923b-eb12294a5655 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:49.638085 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3d775847-b5e9-4966-923b-eb12294a5655 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:49.644677 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d775847-b5e9-4966-923b-eb12294a5655 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:49.645132 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d775847-b5e9-4966-923b-eb12294a5655 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:49.645931 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d775847-b5e9-4966-923b-eb12294a5655 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:49.646370 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3d775847-b5e9-4966-923b-eb12294a5655 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:49.944181 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-eb72b6ec-2c3c-4083-b1ae-0a86c56290d1 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:49.944802 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-eb72b6ec-2c3c-4083-b1ae-0a86c56290d1 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:49.954328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-eb72b6ec-2c3c-4083-b1ae-0a86c56290d1 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:49.954812 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-eb72b6ec-2c3c-4083-b1ae-0a86c56290d1 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:49.959249 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-eb72b6ec-2c3c-4083-b1ae-0a86c56290d1 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:49.959936 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-eb72b6ec-2c3c-4083-b1ae-0a86c56290d1 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:50.276759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3d775847-b5e9-4966-923b-eb12294a5655 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:50.285836 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3d775847-b5e9-4966-923b-eb12294a5655 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.653961 Feb 28 10:37:50.298903 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 362/761] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:49 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:50.332835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-eb72b6ec-2c3c-4083-b1ae-0a86c56290d1 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:50.344196 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-eb72b6ec-2c3c-4083-b1ae-0a86c56290d1 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.403761 Feb 28 10:37:50.345317 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 400/762] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:49 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:50.638134 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:50.638809 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:50.645274 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:50.645928 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:50.646932 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:50.647555 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:50.811241 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:50.836178 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:50.838175 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:50.841009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-504bec40-0252-48ac-8d9f-2a8a664e50a6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.207046 Feb 28 10:37:50.856575 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 363/763] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:50 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:51.303109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d6abf736-b1fa-4174-b852-a830cddaf8e9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:51.303737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d6abf736-b1fa-4174-b852-a830cddaf8e9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:51.311243 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d6abf736-b1fa-4174-b852-a830cddaf8e9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:51.311680 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d6abf736-b1fa-4174-b852-a830cddaf8e9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:51.312456 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d6abf736-b1fa-4174-b852-a830cddaf8e9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:51.312884 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d6abf736-b1fa-4174-b852-a830cddaf8e9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:51.373155 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2b5705ba-5e3f-4f2a-922a-f398b8f402be tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:51.374280 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2b5705ba-5e3f-4f2a-922a-f398b8f402be tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:51.382111 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2b5705ba-5e3f-4f2a-922a-f398b8f402be tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:51.383087 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2b5705ba-5e3f-4f2a-922a-f398b8f402be tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:51.384236 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2b5705ba-5e3f-4f2a-922a-f398b8f402be tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:51.385184 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2b5705ba-5e3f-4f2a-922a-f398b8f402be tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:51.728678 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d6abf736-b1fa-4174-b852-a830cddaf8e9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:51.736230 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2b5705ba-5e3f-4f2a-922a-f398b8f402be tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:51.738258 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d6abf736-b1fa-4174-b852-a830cddaf8e9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.438929 Feb 28 10:37:51.750209 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 401/764] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:51 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:51.752978 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2b5705ba-5e3f-4f2a-922a-f398b8f402be tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.389200 Feb 28 10:37:51.753859 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 364/765] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:51 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:51.865178 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:51.866370 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:51.874222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:51.874726 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:51.875735 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:51.876691 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:52.297595 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:52.307291 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:52.311879 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:52.313397 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c058ec80-9343-421e-bd3e-801cdb33292d tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.453189 Feb 28 10:37:52.325338 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 402/766] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:51 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:37:52.756365 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-948a816a-230e-49e8-89f4-07a543b660be tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:52.757064 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-948a816a-230e-49e8-89f4-07a543b660be tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:52.764621 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-948a816a-230e-49e8-89f4-07a543b660be tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:52.765194 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-948a816a-230e-49e8-89f4-07a543b660be tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:52.766115 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-948a816a-230e-49e8-89f4-07a543b660be tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:52.766680 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-948a816a-230e-49e8-89f4-07a543b660be tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:52.769806 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-94094714-7759-4987-b39f-426e5dc68e76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:52.770432 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-94094714-7759-4987-b39f-426e5dc68e76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:52.776818 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-94094714-7759-4987-b39f-426e5dc68e76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:52.777278 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-94094714-7759-4987-b39f-426e5dc68e76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:52.778086 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-94094714-7759-4987-b39f-426e5dc68e76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:52.778527 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-94094714-7759-4987-b39f-426e5dc68e76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:52.997940 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-948a816a-230e-49e8-89f4-07a543b660be tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:53.003271 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-94094714-7759-4987-b39f-426e5dc68e76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:53.007505 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-948a816a-230e-49e8-89f4-07a543b660be tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.255024 Feb 28 10:37:53.018660 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-94094714-7759-4987-b39f-426e5dc68e76 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.252568 Feb 28 10:37:53.018936 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 365/767] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:52 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:53.022737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 403/768] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:52 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:53.332183 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:53.333036 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:53.338881 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:53.339339 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:53.340183 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:53.340620 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:53.520070 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:53.529825 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:53.531508 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:53.532562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f29960ac-cc5b-497e-ad63-bd3f5b4aaaed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.204252 Feb 28 10:37:53.534174 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 366/769] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:53 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:54.026226 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-82e8e787-2026-4070-874b-c1a98b14bda8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:54.027333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-82e8e787-2026-4070-874b-c1a98b14bda8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:54.033652 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82e8e787-2026-4070-874b-c1a98b14bda8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:54.034099 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82e8e787-2026-4070-874b-c1a98b14bda8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:54.034907 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82e8e787-2026-4070-874b-c1a98b14bda8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:54.035342 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82e8e787-2026-4070-874b-c1a98b14bda8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:54.052340 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d7a8797a-869a-4d4c-b8b8-f987e1d5f855 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:54.052950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d7a8797a-869a-4d4c-b8b8-f987e1d5f855 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:54.059383 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7a8797a-869a-4d4c-b8b8-f987e1d5f855 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:54.059834 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7a8797a-869a-4d4c-b8b8-f987e1d5f855 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:54.060614 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7a8797a-869a-4d4c-b8b8-f987e1d5f855 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:54.061048 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7a8797a-869a-4d4c-b8b8-f987e1d5f855 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:54.244711 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-82e8e787-2026-4070-874b-c1a98b14bda8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:54.252054 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-82e8e787-2026-4070-874b-c1a98b14bda8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.229777 Feb 28 10:37:54.252634 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 404/770] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:54 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:54.261010 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d7a8797a-869a-4d4c-b8b8-f987e1d5f855 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:54.269052 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d7a8797a-869a-4d4c-b8b8-f987e1d5f855 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.220558 Feb 28 10:37:54.269612 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 367/771] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:54 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:54.551856 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:54.552468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:54.559161 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:54.559618 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:54.560403 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:54.560843 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:54.698706 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:54.708023 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:54.709653 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:54.710820 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e5a1b8e9-259f-4f8d-af2c-b4c88a5cf471 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.162872 Feb 28 10:37:54.711384 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 405/772] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:54 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:37:55.269332 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-19f99825-5fb9-4523-816b-ff34f0ed8d70 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:55.269939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-19f99825-5fb9-4523-816b-ff34f0ed8d70 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:55.276274 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-19f99825-5fb9-4523-816b-ff34f0ed8d70 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:55.276738 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-19f99825-5fb9-4523-816b-ff34f0ed8d70 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:55.277506 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-19f99825-5fb9-4523-816b-ff34f0ed8d70 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:55.277939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-19f99825-5fb9-4523-816b-ff34f0ed8d70 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:55.286245 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-10eedd56-3e0b-440e-8457-c378b9bea6e3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:55.286895 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-10eedd56-3e0b-440e-8457-c378b9bea6e3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:55.293877 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-10eedd56-3e0b-440e-8457-c378b9bea6e3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:55.294327 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-10eedd56-3e0b-440e-8457-c378b9bea6e3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:55.295141 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-10eedd56-3e0b-440e-8457-c378b9bea6e3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:55.295576 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-10eedd56-3e0b-440e-8457-c378b9bea6e3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:55.492198 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-19f99825-5fb9-4523-816b-ff34f0ed8d70 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:55.496657 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-10eedd56-3e0b-440e-8457-c378b9bea6e3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:55.499747 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-19f99825-5fb9-4523-816b-ff34f0ed8d70 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1317 microversion: 2.1 time: 0.234288 Feb 28 10:37:55.500360 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 368/773] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:55 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:55.504115 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-10eedd56-3e0b-440e-8457-c378b9bea6e3 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.221594 Feb 28 10:37:55.504672 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 406/774] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:55 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:55.729676 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:55.730732 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:55.736546 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:55.736997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:55.737774 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:55.738204 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:55.876079 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:55.883842 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:55.885356 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:55.886666 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-53d04307-8bf9-44af-9441-3d2c72cbe75b tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.160885 Feb 28 10:37:55.887428 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 369/775] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:55 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:56.518136 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0cf7b27c-7679-4145-93bc-0d45c9a604ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:56.518781 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0cf7b27c-7679-4145-93bc-0d45c9a604ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:56.521546 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-7c27b8d5-3930-4cbc-85ea-72ecaa385f1f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:56.522269 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-7c27b8d5-3930-4cbc-85ea-72ecaa385f1f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:56.525412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0cf7b27c-7679-4145-93bc-0d45c9a604ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:56.525867 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0cf7b27c-7679-4145-93bc-0d45c9a604ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:56.526676 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0cf7b27c-7679-4145-93bc-0d45c9a604ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:56.527143 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0cf7b27c-7679-4145-93bc-0d45c9a604ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:56.528851 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7c27b8d5-3930-4cbc-85ea-72ecaa385f1f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:56.529303 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7c27b8d5-3930-4cbc-85ea-72ecaa385f1f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:56.530297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7c27b8d5-3930-4cbc-85ea-72ecaa385f1f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:56.532303 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-7c27b8d5-3930-4cbc-85ea-72ecaa385f1f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:56.726194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0cf7b27c-7679-4145-93bc-0d45c9a604ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:56.734302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0cf7b27c-7679-4145-93bc-0d45c9a604ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1506 microversion: 2.1 time: 0.220176 Feb 28 10:37:56.734999 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 407/776] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:56 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:56.740422 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-7c27b8d5-3930-4cbc-85ea-72ecaa385f1f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:56.750435 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-7c27b8d5-3930-4cbc-85ea-72ecaa385f1f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.233080 Feb 28 10:37:56.751028 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 370/777] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:56 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:56.905362 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:56.906451 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:56.912740 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:56.913192 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:56.913985 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:56.914482 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:57.084955 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:57.094882 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:57.096452 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:57.097622 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-7ee3216c-6c8c-4ad4-8b40-f34a439369ed tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.196995 Feb 28 10:37:57.098646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 408/778] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:56 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:57.767882 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-bf3ce9f1-b3fe-4c44-a702-a7e6eaeb02ba tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:57.768487 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-bf3ce9f1-b3fe-4c44-a702-a7e6eaeb02ba tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:57.774693 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bf3ce9f1-b3fe-4c44-a702-a7e6eaeb02ba tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:57.775135 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bf3ce9f1-b3fe-4c44-a702-a7e6eaeb02ba tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:57.775895 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bf3ce9f1-b3fe-4c44-a702-a7e6eaeb02ba tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:57.776351 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bf3ce9f1-b3fe-4c44-a702-a7e6eaeb02ba tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:57.909921 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-bf3ce9f1-b3fe-4c44-a702-a7e6eaeb02ba tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:57.917164 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-bf3ce9f1-b3fe-4c44-a702-a7e6eaeb02ba tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1511 microversion: 2.1 time: 0.153147 Feb 28 10:37:57.917774 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 371/779] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:57 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:57.933648 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b2261c88-57ec-4de8-9445-dac213fe2220 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:57.934215 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b2261c88-57ec-4de8-9445-dac213fe2220 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:57.940426 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b2261c88-57ec-4de8-9445-dac213fe2220 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:57.940874 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b2261c88-57ec-4de8-9445-dac213fe2220 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:57.941651 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b2261c88-57ec-4de8-9445-dac213fe2220 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:57.942087 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b2261c88-57ec-4de8-9445-dac213fe2220 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:58.018181 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b2261c88-57ec-4de8-9445-dac213fe2220 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "POST /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c/action" status: 202 len: 0 microversion: 2.1 time: 0.088287 Feb 28 10:37:58.018668 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 409/780] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 10:37:57 2022] POST /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:37:58.027049 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ec10960e-08c1-40e2-a7b1-4cca32f9a362 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:58.027473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ec10960e-08c1-40e2-a7b1-4cca32f9a362 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:58.033212 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ec10960e-08c1-40e2-a7b1-4cca32f9a362 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:58.033671 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ec10960e-08c1-40e2-a7b1-4cca32f9a362 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:58.034619 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ec10960e-08c1-40e2-a7b1-4cca32f9a362 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:58.035154 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ec10960e-08c1-40e2-a7b1-4cca32f9a362 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:58.108417 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-93602462-b827-466b-8f3d-e4b4d863c6eb tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03bcd47d-60a0-4381-aedc-6829a20774fc"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:37:58.109550 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-93602462-b827-466b-8f3d-e4b4d863c6eb tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:58.126402 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-93602462-b827-466b-8f3d-e4b4d863c6eb tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:58.126877 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-93602462-b827-466b-8f3d-e4b4d863c6eb tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:58.127675 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-93602462-b827-466b-8f3d-e4b4d863c6eb tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:58.128106 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-93602462-b827-466b-8f3d-e4b4d863c6eb tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:58.206584 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ec10960e-08c1-40e2-a7b1-4cca32f9a362 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:58.215724 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ec10960e-08c1-40e2-a7b1-4cca32f9a362 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1519 microversion: 2.1 time: 0.192822 Feb 28 10:37:58.216977 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 372/781] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:58 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:37:58.221390 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:58.222085 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:58.229067 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:58.229523 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:58.230905 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:58.231339 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:58.441047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:58.450806 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:58.453315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:58.466773 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9bbc22b7-1027-4aa1-b26f-85a3b5a66008 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.249178 Feb 28 10:37:58.467449 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 373/782] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:58 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:37:58.499492 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-93602462-b827-466b-8f3d-e4b4d863c6eb tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "POST /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395647 Feb 28 10:37:58.500113 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 410/783] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:37:58 2022] POST /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:37:59.233629 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b3a19e04-ab3c-47bf-8e02-e8c89d797c74 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:59.234223 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b3a19e04-ab3c-47bf-8e02-e8c89d797c74 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:59.240498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b3a19e04-ab3c-47bf-8e02-e8c89d797c74 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:59.240952 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b3a19e04-ab3c-47bf-8e02-e8c89d797c74 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:59.241727 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b3a19e04-ab3c-47bf-8e02-e8c89d797c74 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:59.242164 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b3a19e04-ab3c-47bf-8e02-e8c89d797c74 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:59.380650 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b3a19e04-ab3c-47bf-8e02-e8c89d797c74 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:59.390083 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b3a19e04-ab3c-47bf-8e02-e8c89d797c74 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1521 microversion: 2.1 time: 0.160271 Feb 28 10:37:59.390535 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 374/784] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:37:59 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:37:59.486851 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:37:59.487544 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:37:59.493668 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:59.494116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:59.494920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:37:59.495356 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:37:59.632442 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:59.640747 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:59.642194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:37:59.643366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3dfde2f4-ea9a-4815-b821-64d0328cdbe2 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.161312 Feb 28 10:37:59.643932 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 411/785] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:37:59 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:38:00.408349 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-af53cf42-9e8d-4acd-9c80-6eb5dceb755c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:00.408991 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-af53cf42-9e8d-4acd-9c80-6eb5dceb755c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:00.415242 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-af53cf42-9e8d-4acd-9c80-6eb5dceb755c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:00.415686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-af53cf42-9e8d-4acd-9c80-6eb5dceb755c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:00.416457 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-af53cf42-9e8d-4acd-9c80-6eb5dceb755c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:00.416891 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-af53cf42-9e8d-4acd-9c80-6eb5dceb755c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:00.552044 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-af53cf42-9e8d-4acd-9c80-6eb5dceb755c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:00.560315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-af53cf42-9e8d-4acd-9c80-6eb5dceb755c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1521 microversion: 2.1 time: 0.155865 Feb 28 10:38:00.560859 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 375/786] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:00 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:00.661258 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:00.661813 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:00.668648 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:00.669098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:00.669887 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:00.670327 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:00.807005 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:00.815042 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:00.816522 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:00.817654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ef41463f-d638-4349-bc32-844b0fddc39e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.160319 Feb 28 10:38:00.818219 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 412/787] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:00 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:38:01.208250 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-3c61e0cb-487f-40ec-8214-854aebf13bb5 req-4cf806b2-cf27-48d6-a0cb-f8c2675da07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d16ba15-2ef6-4ce9-a9cd-d5e14657271a", "name": "network-vif-plugged", "status": "completed", "tag": "c091db1b-3683-4633-8290-5a1701243cc7"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:01.218009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-3c61e0cb-487f-40ec-8214-854aebf13bb5 req-4cf806b2-cf27-48d6-a0cb-f8c2675da07a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:01.218455 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-3c61e0cb-487f-40ec-8214-854aebf13bb5 req-4cf806b2-cf27-48d6-a0cb-f8c2675da07a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:01.230866 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-3c61e0cb-487f-40ec-8214-854aebf13bb5 req-4cf806b2-cf27-48d6-a0cb-f8c2675da07a service nova] Creating event network-vif-plugged:c091db1b-3683-4633-8290-5a1701243cc7 for instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a on hv-cinder-maste Feb 28 10:38:01.235855 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-3c61e0cb-487f-40ec-8214-854aebf13bb5 req-4cf806b2-cf27-48d6-a0cb-f8c2675da07a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031283 Feb 28 10:38:01.236456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 376/788] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:01.577880 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-dec273be-1f98-484a-a46b-3ed75fa44405 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:01.578408 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-dec273be-1f98-484a-a46b-3ed75fa44405 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:01.585034 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-dec273be-1f98-484a-a46b-3ed75fa44405 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:01.585474 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-dec273be-1f98-484a-a46b-3ed75fa44405 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:01.586286 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-dec273be-1f98-484a-a46b-3ed75fa44405 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:01.586782 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-dec273be-1f98-484a-a46b-3ed75fa44405 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:01.723696 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-dec273be-1f98-484a-a46b-3ed75fa44405 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:01.731218 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-dec273be-1f98-484a-a46b-3ed75fa44405 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1521 microversion: 2.1 time: 0.157804 Feb 28 10:38:01.731797 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 413/789] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:01 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:01.837786 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:01.838417 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:01.845411 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:01.845866 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:01.846680 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:01.847123 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:01.986327 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:01.993959 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:01.995473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:01.997131 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-07d54451-a737-4ad4-81ba-2f39f4885703 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.164100 Feb 28 10:38:01.997690 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 377/790] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:01 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:38:02.749089 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4ee80066-24cd-4890-a305-cda69265acb8 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:02.750259 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4ee80066-24cd-4890-a305-cda69265acb8 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:02.756561 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ee80066-24cd-4890-a305-cda69265acb8 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:02.756914 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ee80066-24cd-4890-a305-cda69265acb8 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:02.757714 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ee80066-24cd-4890-a305-cda69265acb8 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:02.758368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4ee80066-24cd-4890-a305-cda69265acb8 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:02.918796 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4ee80066-24cd-4890-a305-cda69265acb8 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:02.927067 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4ee80066-24cd-4890-a305-cda69265acb8 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1521 microversion: 2.1 time: 0.182479 Feb 28 10:38:02.927730 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 414/791] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:02 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:03.015700 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:03.016433 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:03.023551 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:03.024009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:03.025027 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:03.025483 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:03.164865 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:03.174441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:03.176055 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:03.177243 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8162f803-2cf1-4ff4-8c60-6a1760844243 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1732 microversion: 2.20 time: 0.165950 Feb 28 10:38:03.177798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 378/792] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:03 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:38:03.253875 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-0319a48d-0bd2-4090-a8ce-29c2a90ef4cc req-63edfa20-d871-44e9-96e1-06dc6351c0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6a8a33-e76e-450b-a94a-a0852fc6472c", "name": "network-vif-unplugged", "status": "completed", "tag": "c294705d-35da-4f5d-8e43-0a930f3b63a3"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:03.263171 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-0319a48d-0bd2-4090-a8ce-29c2a90ef4cc req-63edfa20-d871-44e9-96e1-06dc6351c0c0 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:03.263609 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-0319a48d-0bd2-4090-a8ce-29c2a90ef4cc req-63edfa20-d871-44e9-96e1-06dc6351c0c0 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:03.274029 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.compute.server_external_events [req-0319a48d-0bd2-4090-a8ce-29c2a90ef4cc req-63edfa20-d871-44e9-96e1-06dc6351c0c0 service nova] Unable to find a host for instance 6f6a8a33-e76e-450b-a94a-a0852fc6472c. Dropping event network-vif-unplugged {{(pid=123152) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Feb 28 10:38:03.274893 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-0319a48d-0bd2-4090-a8ce-29c2a90ef4cc req-63edfa20-d871-44e9-96e1-06dc6351c0c0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024817 Feb 28 10:38:03.275476 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 415/793] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 28 10:38:03.944495 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d7f1ed3f-5b02-4d8a-800d-282464fe013e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:03.945113 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d7f1ed3f-5b02-4d8a-800d-282464fe013e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:03.951574 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7f1ed3f-5b02-4d8a-800d-282464fe013e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:03.952021 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7f1ed3f-5b02-4d8a-800d-282464fe013e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:03.952794 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7f1ed3f-5b02-4d8a-800d-282464fe013e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:03.953226 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d7f1ed3f-5b02-4d8a-800d-282464fe013e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:04.091592 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d7f1ed3f-5b02-4d8a-800d-282464fe013e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:04.099209 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d7f1ed3f-5b02-4d8a-800d-282464fe013e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1521 microversion: 2.1 time: 0.158935 Feb 28 10:38:04.099812 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 379/794] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:03 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:04.196034 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:04.196689 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:04.203387 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:04.203836 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:04.204616 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:04.205053 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:04.338222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:04.347169 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:04.348677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:04.350188 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5f54aaba-f5bd-498f-9aaf-13f7c6f89d95 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1719 microversion: 2.20 time: 0.157698 Feb 28 10:38:04.350788 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 416/795] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:04 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:38:05.116339 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-71dd035c-3066-43f8-8e0b-3bb8dcc4bf0e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:05.116899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-71dd035c-3066-43f8-8e0b-3bb8dcc4bf0e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:05.123582 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71dd035c-3066-43f8-8e0b-3bb8dcc4bf0e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:05.124031 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71dd035c-3066-43f8-8e0b-3bb8dcc4bf0e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:05.124814 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71dd035c-3066-43f8-8e0b-3bb8dcc4bf0e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:05.125250 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-71dd035c-3066-43f8-8e0b-3bb8dcc4bf0e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:05.263376 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-71dd035c-3066-43f8-8e0b-3bb8dcc4bf0e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:05.270680 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-71dd035c-3066-43f8-8e0b-3bb8dcc4bf0e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1521 microversion: 2.1 time: 0.158421 Feb 28 10:38:05.271243 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 380/796] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:05 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:06.077318 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-377012766", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "networks": [{"uuid": "385c32c8-9d90-44b6-bcc3-678e48a38bb6"}]}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:06.129842 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.network.neutron [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] validate_networks() for [('385c32c8-9d90-44b6-bcc3-678e48a38bb6', None, None, None, None, None)] {{(pid=123152) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:38:06.287736 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6a933799-b41e-4911-815d-4cb44b529954 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:06.288353 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6a933799-b41e-4911-815d-4cb44b529954 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:06.295509 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a933799-b41e-4911-815d-4cb44b529954 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:06.296082 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a933799-b41e-4911-815d-4cb44b529954 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:06.296994 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a933799-b41e-4911-815d-4cb44b529954 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:06.297705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6a933799-b41e-4911-815d-4cb44b529954 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:06.563036 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6a933799-b41e-4911-815d-4cb44b529954 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:06.570293 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6a933799-b41e-4911-815d-4cb44b529954 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.286425 Feb 28 10:38:06.570878 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 381/797] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:06 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:38:06.581178 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Flavor limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:38:06.581178 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Image limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:38:06.581543 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Flavor pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:38:06.582007 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Image pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:38:06.582418 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:38:06.592237 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:06.592680 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:06.593492 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:06.593922 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:06.612655 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Getting quotas for project 5c79b1decd974ef2bb73bf55edc02f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:38:06.616551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Getting quotas for user 3cdcba6d332b492196494db46ced8b9f and project 5c79b1decd974ef2bb73bf55edc02f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:38:06.628459 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Going to run 1 instances... {{(pid=123152) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:38:06.630738 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:38:06.677168 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-fb185891-f40a-449f-8beb-424d09ddb13e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603727 Feb 28 10:38:06.678124 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 417/798] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:38:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:38:06.688952 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3741a907-6e1b-49e3-a7de-31493e90ecb4 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:06.689672 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3741a907-6e1b-49e3-a7de-31493e90ecb4 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:06.748367 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3741a907-6e1b-49e3-a7de-31493e90ecb4 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:06.754938 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3741a907-6e1b-49e3-a7de-31493e90ecb4 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1217 microversion: 2.1 time: 0.070168 Feb 28 10:38:06.755664 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 382/799] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:06 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:07.589319 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-aab3b3e4-be9b-4e8c-9606-97c67638b207 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:07.590205 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-aab3b3e4-be9b-4e8c-9606-97c67638b207 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:07.596492 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aab3b3e4-be9b-4e8c-9606-97c67638b207 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:07.596933 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aab3b3e4-be9b-4e8c-9606-97c67638b207 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:07.597706 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aab3b3e4-be9b-4e8c-9606-97c67638b207 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:07.598131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-aab3b3e4-be9b-4e8c-9606-97c67638b207 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:07.742070 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-aab3b3e4-be9b-4e8c-9606-97c67638b207 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:07.749695 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-aab3b3e4-be9b-4e8c-9606-97c67638b207 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.165937 Feb 28 10:38:07.750318 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 418/800] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:07 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:07.772669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2f00b8c4-3c00-49b0-9117-8b6fdb467b61 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:07.773377 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2f00b8c4-3c00-49b0-9117-8b6fdb467b61 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:07.781535 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2f00b8c4-3c00-49b0-9117-8b6fdb467b61 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:07.782098 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2f00b8c4-3c00-49b0-9117-8b6fdb467b61 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:07.783421 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2f00b8c4-3c00-49b0-9117-8b6fdb467b61 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:07.783926 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2f00b8c4-3c00-49b0-9117-8b6fdb467b61 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:07.860918 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2f00b8c4-3c00-49b0-9117-8b6fdb467b61 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:07.868201 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2f00b8c4-3c00-49b0-9117-8b6fdb467b61 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1287 microversion: 2.1 time: 0.099465 Feb 28 10:38:07.868759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 383/801] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:07 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:08.766800 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d1f06d0b-ee3b-43fb-b9a4-4f7aaa88f7af tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:08.767352 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d1f06d0b-ee3b-43fb-b9a4-4f7aaa88f7af tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:08.773491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d1f06d0b-ee3b-43fb-b9a4-4f7aaa88f7af tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:08.773940 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d1f06d0b-ee3b-43fb-b9a4-4f7aaa88f7af tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:08.774783 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d1f06d0b-ee3b-43fb-b9a4-4f7aaa88f7af tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:08.775220 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d1f06d0b-ee3b-43fb-b9a4-4f7aaa88f7af tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:08.885468 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e5e36792-83cd-412c-9870-b44af0365db3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:08.886259 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e5e36792-83cd-412c-9870-b44af0365db3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:08.893510 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e5e36792-83cd-412c-9870-b44af0365db3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:08.894172 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e5e36792-83cd-412c-9870-b44af0365db3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:08.895232 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e5e36792-83cd-412c-9870-b44af0365db3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:08.895945 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e5e36792-83cd-412c-9870-b44af0365db3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:08.920941 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d1f06d0b-ee3b-43fb-b9a4-4f7aaa88f7af tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:08.930320 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d1f06d0b-ee3b-43fb-b9a4-4f7aaa88f7af tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.167185 Feb 28 10:38:08.931199 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 419/802] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:08 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:09.044342 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e5e36792-83cd-412c-9870-b44af0365db3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:09.052115 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e5e36792-83cd-412c-9870-b44af0365db3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1317 microversion: 2.1 time: 0.170957 Feb 28 10:38:09.052701 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 384/803] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:08 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:38:09.064711 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-52cde764-990f-4af8-8da1-7db20f03d343 req-17fd8708-4c42-45fc-a571-8fffd6b10cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69d4311-bc1d-48b3-b94e-2584548842d8", "tag": "a01d0d57-ecde-4dc6-9390-13e26151d5a6"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:09.075361 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-52cde764-990f-4af8-8da1-7db20f03d343 req-17fd8708-4c42-45fc-a571-8fffd6b10cff service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:09.076062 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-52cde764-990f-4af8-8da1-7db20f03d343 req-17fd8708-4c42-45fc-a571-8fffd6b10cff service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:09.087547 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-52cde764-990f-4af8-8da1-7db20f03d343 req-17fd8708-4c42-45fc-a571-8fffd6b10cff service nova] Creating event network-changed:a01d0d57-ecde-4dc6-9390-13e26151d5a6 for instance b69d4311-bc1d-48b3-b94e-2584548842d8 on hv-cinder-maste Feb 28 10:38:09.092810 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-52cde764-990f-4af8-8da1-7db20f03d343 req-17fd8708-4c42-45fc-a571-8fffd6b10cff service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032036 Feb 28 10:38:09.093404 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 420/804] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:09.956037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-016d2d62-4a9d-4072-830a-2f593de2c829 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:09.956577 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-016d2d62-4a9d-4072-830a-2f593de2c829 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:09.962826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-016d2d62-4a9d-4072-830a-2f593de2c829 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:09.963279 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-016d2d62-4a9d-4072-830a-2f593de2c829 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:09.964066 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-016d2d62-4a9d-4072-830a-2f593de2c829 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:09.964541 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-016d2d62-4a9d-4072-830a-2f593de2c829 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:10.073634 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-36c28297-12cb-40e0-91e6-b34932f959e7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:10.075451 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-36c28297-12cb-40e0-91e6-b34932f959e7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:10.082070 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-36c28297-12cb-40e0-91e6-b34932f959e7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:10.082521 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-36c28297-12cb-40e0-91e6-b34932f959e7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:10.083334 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-36c28297-12cb-40e0-91e6-b34932f959e7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:10.083943 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-36c28297-12cb-40e0-91e6-b34932f959e7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:10.105013 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-016d2d62-4a9d-4072-830a-2f593de2c829 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:10.112459 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-016d2d62-4a9d-4072-830a-2f593de2c829 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.160352 Feb 28 10:38:10.113033 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 385/805] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:09 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:10.226686 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-36c28297-12cb-40e0-91e6-b34932f959e7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:10.235531 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-36c28297-12cb-40e0-91e6-b34932f959e7 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1317 microversion: 2.1 time: 0.170032 Feb 28 10:38:10.236368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 421/806] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:10 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:38:11.129830 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e1906011-45d7-4bf9-98b9-83f538fc5b00 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:11.130345 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e1906011-45d7-4bf9-98b9-83f538fc5b00 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:11.136465 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e1906011-45d7-4bf9-98b9-83f538fc5b00 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:11.136907 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e1906011-45d7-4bf9-98b9-83f538fc5b00 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:11.137675 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e1906011-45d7-4bf9-98b9-83f538fc5b00 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:11.138102 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e1906011-45d7-4bf9-98b9-83f538fc5b00 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:11.253803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-66c2b154-be99-4f1b-abf6-16252e9d906b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:11.254430 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-66c2b154-be99-4f1b-abf6-16252e9d906b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:11.260623 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-66c2b154-be99-4f1b-abf6-16252e9d906b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:11.261070 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-66c2b154-be99-4f1b-abf6-16252e9d906b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:11.261842 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-66c2b154-be99-4f1b-abf6-16252e9d906b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:11.262268 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-66c2b154-be99-4f1b-abf6-16252e9d906b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:11.273318 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e1906011-45d7-4bf9-98b9-83f538fc5b00 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:11.281157 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e1906011-45d7-4bf9-98b9-83f538fc5b00 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.155323 Feb 28 10:38:11.281729 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 386/807] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:11 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:11.400172 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-66c2b154-be99-4f1b-abf6-16252e9d906b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:11.407720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-66c2b154-be99-4f1b-abf6-16252e9d906b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1317 microversion: 2.1 time: 0.157822 Feb 28 10:38:11.408302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 422/808] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:11 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:12.298008 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-03e1728a-ac8e-483a-b9ad-78d0539bd560 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:12.298649 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-03e1728a-ac8e-483a-b9ad-78d0539bd560 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:12.304940 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-03e1728a-ac8e-483a-b9ad-78d0539bd560 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:12.305393 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-03e1728a-ac8e-483a-b9ad-78d0539bd560 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:12.306170 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-03e1728a-ac8e-483a-b9ad-78d0539bd560 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:12.306620 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-03e1728a-ac8e-483a-b9ad-78d0539bd560 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:12.424962 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-57404340-f405-49dd-8285-dbfdc19ae8d9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:12.425579 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-57404340-f405-49dd-8285-dbfdc19ae8d9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:12.431702 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-57404340-f405-49dd-8285-dbfdc19ae8d9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:12.432140 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-57404340-f405-49dd-8285-dbfdc19ae8d9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:12.432910 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-57404340-f405-49dd-8285-dbfdc19ae8d9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:12.433338 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-57404340-f405-49dd-8285-dbfdc19ae8d9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:12.441018 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-03e1728a-ac8e-483a-b9ad-78d0539bd560 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:12.448354 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-03e1728a-ac8e-483a-b9ad-78d0539bd560 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.154222 Feb 28 10:38:12.448924 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 387/809] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:12 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:12.568028 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-57404340-f405-49dd-8285-dbfdc19ae8d9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:12.575277 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-57404340-f405-49dd-8285-dbfdc19ae8d9 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1317 microversion: 2.1 time: 0.154117 Feb 28 10:38:12.576424 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 423/810] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:12 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:13.465140 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f654e5cb-2d92-4614-bd27-62790e2897ac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:13.465711 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f654e5cb-2d92-4614-bd27-62790e2897ac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:13.472593 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f654e5cb-2d92-4614-bd27-62790e2897ac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:13.473039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f654e5cb-2d92-4614-bd27-62790e2897ac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:13.473813 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f654e5cb-2d92-4614-bd27-62790e2897ac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:13.474247 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f654e5cb-2d92-4614-bd27-62790e2897ac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:13.593292 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-99a0b05e-97ee-4d28-b815-d6c4e1534cd2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:13.593908 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-99a0b05e-97ee-4d28-b815-d6c4e1534cd2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:13.600549 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-99a0b05e-97ee-4d28-b815-d6c4e1534cd2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:13.600997 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-99a0b05e-97ee-4d28-b815-d6c4e1534cd2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:13.601782 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-99a0b05e-97ee-4d28-b815-d6c4e1534cd2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:13.602232 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-99a0b05e-97ee-4d28-b815-d6c4e1534cd2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:13.612330 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f654e5cb-2d92-4614-bd27-62790e2897ac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:13.619736 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f654e5cb-2d92-4614-bd27-62790e2897ac tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.158489 Feb 28 10:38:13.620299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 388/811] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:13 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:13.744921 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-99a0b05e-97ee-4d28-b815-d6c4e1534cd2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:13.752385 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-99a0b05e-97ee-4d28-b815-d6c4e1534cd2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1317 microversion: 2.1 time: 0.163522 Feb 28 10:38:13.752957 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 424/812] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:13 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:38:14.636101 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e50ff86b-f543-4890-8a5e-40d66b61ac3c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:14.636713 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e50ff86b-f543-4890-8a5e-40d66b61ac3c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:14.643062 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e50ff86b-f543-4890-8a5e-40d66b61ac3c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:14.643513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e50ff86b-f543-4890-8a5e-40d66b61ac3c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:14.644290 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e50ff86b-f543-4890-8a5e-40d66b61ac3c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:14.644728 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e50ff86b-f543-4890-8a5e-40d66b61ac3c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:14.769381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-411e8a2d-60d4-4de1-b886-199ff2e49ae3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:14.769994 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-411e8a2d-60d4-4de1-b886-199ff2e49ae3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:14.776171 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-411e8a2d-60d4-4de1-b886-199ff2e49ae3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:14.776617 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-411e8a2d-60d4-4de1-b886-199ff2e49ae3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:14.777398 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-411e8a2d-60d4-4de1-b886-199ff2e49ae3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:14.777829 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-411e8a2d-60d4-4de1-b886-199ff2e49ae3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:14.782829 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e50ff86b-f543-4890-8a5e-40d66b61ac3c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:14.790293 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e50ff86b-f543-4890-8a5e-40d66b61ac3c tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.158070 Feb 28 10:38:14.790865 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 389/813] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:14 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:14.908783 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-411e8a2d-60d4-4de1-b886-199ff2e49ae3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:14.916349 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-411e8a2d-60d4-4de1-b886-199ff2e49ae3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1317 microversion: 2.1 time: 0.150866 Feb 28 10:38:14.916909 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 425/814] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:14 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:38:15.431622 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-af9b055d-56b0-433d-b342-e443b399c892 req-99e69f17-22e3-430d-8de3-fc757a5904b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69d4311-bc1d-48b3-b94e-2584548842d8", "name": "network-vif-plugged", "status": "completed", "tag": "a01d0d57-ecde-4dc6-9390-13e26151d5a6"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:15.439531 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-af9b055d-56b0-433d-b342-e443b399c892 req-99e69f17-22e3-430d-8de3-fc757a5904b9 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:15.439978 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-af9b055d-56b0-433d-b342-e443b399c892 req-99e69f17-22e3-430d-8de3-fc757a5904b9 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:15.453247 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-af9b055d-56b0-433d-b342-e443b399c892 req-99e69f17-22e3-430d-8de3-fc757a5904b9 service nova] Creating event network-vif-plugged:a01d0d57-ecde-4dc6-9390-13e26151d5a6 for instance b69d4311-bc1d-48b3-b94e-2584548842d8 on hv-cinder-maste Feb 28 10:38:15.462362 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-af9b055d-56b0-433d-b342-e443b399c892 req-99e69f17-22e3-430d-8de3-fc757a5904b9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 Feb 28 10:38:15.462362 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 390/815] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:15.807171 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5626bd89-7527-4089-ba05-eba0a2384268 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:15.807841 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5626bd89-7527-4089-ba05-eba0a2384268 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:15.814833 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5626bd89-7527-4089-ba05-eba0a2384268 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:15.815279 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5626bd89-7527-4089-ba05-eba0a2384268 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:15.816064 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5626bd89-7527-4089-ba05-eba0a2384268 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:15.816500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5626bd89-7527-4089-ba05-eba0a2384268 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:15.934124 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-67f00642-4327-4698-bdab-57c3f95dcc97 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:15.934910 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-67f00642-4327-4698-bdab-57c3f95dcc97 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:15.942103 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-67f00642-4327-4698-bdab-57c3f95dcc97 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:15.942897 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-67f00642-4327-4698-bdab-57c3f95dcc97 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:15.943942 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-67f00642-4327-4698-bdab-57c3f95dcc97 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:15.945591 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-67f00642-4327-4698-bdab-57c3f95dcc97 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:15.955281 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5626bd89-7527-4089-ba05-eba0a2384268 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:15.962769 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5626bd89-7527-4089-ba05-eba0a2384268 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.159456 Feb 28 10:38:15.973258 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 426/816] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:15 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:16.088604 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-67f00642-4327-4698-bdab-57c3f95dcc97 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:16.096728 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-67f00642-4327-4698-bdab-57c3f95dcc97 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1317 microversion: 2.1 time: 0.166931 Feb 28 10:38:16.097305 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 391/817] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:15 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:38:16.980077 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d07e9449-61df-4674-86f6-77c60d82d1ee tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:16.980705 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d07e9449-61df-4674-86f6-77c60d82d1ee tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:16.987109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d07e9449-61df-4674-86f6-77c60d82d1ee tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:16.987568 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d07e9449-61df-4674-86f6-77c60d82d1ee tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:16.988356 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d07e9449-61df-4674-86f6-77c60d82d1ee tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:16.988794 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d07e9449-61df-4674-86f6-77c60d82d1ee tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.113427 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0e8e289b-fdff-44d5-b7cc-e3421778bafe tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:17.113989 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0e8e289b-fdff-44d5-b7cc-e3421778bafe tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:17.123305 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d07e9449-61df-4674-86f6-77c60d82d1ee tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:17.128747 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0e8e289b-fdff-44d5-b7cc-e3421778bafe tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:17.128940 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0e8e289b-fdff-44d5-b7cc-e3421778bafe tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.129740 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0e8e289b-fdff-44d5-b7cc-e3421778bafe tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:17.130205 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0e8e289b-fdff-44d5-b7cc-e3421778bafe tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.131790 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d07e9449-61df-4674-86f6-77c60d82d1ee tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.155536 Feb 28 10:38:17.132362 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 427/818] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:16 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:17.267455 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0e8e289b-fdff-44d5-b7cc-e3421778bafe tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:17.274793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0e8e289b-fdff-44d5-b7cc-e3421778bafe tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1506 microversion: 2.1 time: 0.165255 Feb 28 10:38:17.275363 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 392/819] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:17 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:17.291934 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-974db339-a115-47ed-9b88-f1040757db66 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03bcd47d-60a0-4381-aedc-6829a20774fc"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:17.292999 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-974db339-a115-47ed-9b88-f1040757db66 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:17.300118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-974db339-a115-47ed-9b88-f1040757db66 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:17.300643 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-974db339-a115-47ed-9b88-f1040757db66 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.301361 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-974db339-a115-47ed-9b88-f1040757db66 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:17.301797 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-974db339-a115-47ed-9b88-f1040757db66 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.378736 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-974db339-a115-47ed-9b88-f1040757db66 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] HTTP exception thrown: Invalid volume: volume 03bcd47d-60a0-4381-aedc-6829a20774fc is already attached to instances: c9afa739-da2b-478b-af9a-7ea5ad86650d Feb 28 10:38:17.379372 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-974db339-a115-47ed-9b88-f1040757db66 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Returning 400 to user: Invalid volume: volume 03bcd47d-60a0-4381-aedc-6829a20774fc is already attached to instances: c9afa739-da2b-478b-af9a-7ea5ad86650d {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:38:17.380201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-974db339-a115-47ed-9b88-f1040757db66 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "POST /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092397 Feb 28 10:38:17.380743 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 428/820] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:38:17 2022] POST /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 28 10:38:17.439484 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a09911f7-19da-4676-bca0-6a7bc5bfafc3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:17.439985 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a09911f7-19da-4676-bca0-6a7bc5bfafc3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:17.445732 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a09911f7-19da-4676-bca0-6a7bc5bfafc3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:17.446186 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a09911f7-19da-4676-bca0-6a7bc5bfafc3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.446990 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a09911f7-19da-4676-bca0-6a7bc5bfafc3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:17.447428 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a09911f7-19da-4676-bca0-6a7bc5bfafc3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.474620 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-99bbf5e0-2f6b-4818-bf4d-00117c41a647 req-f1aa353b-26ec-4f7a-afa7-d7a6ca6de361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6a8a33-e76e-450b-a94a-a0852fc6472c", "name": "network-vif-plugged", "status": "completed", "tag": "c294705d-35da-4f5d-8e43-0a930f3b63a3"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:17.485183 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-99bbf5e0-2f6b-4818-bf4d-00117c41a647 req-f1aa353b-26ec-4f7a-afa7-d7a6ca6de361 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:17.485623 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-99bbf5e0-2f6b-4818-bf4d-00117c41a647 req-f1aa353b-26ec-4f7a-afa7-d7a6ca6de361 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.495736 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-99bbf5e0-2f6b-4818-bf4d-00117c41a647 req-f1aa353b-26ec-4f7a-afa7-d7a6ca6de361 service nova] Creating event network-vif-plugged:c294705d-35da-4f5d-8e43-0a930f3b63a3 for instance 6f6a8a33-e76e-450b-a94a-a0852fc6472c on hv-cinder-maste Feb 28 10:38:17.502710 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-99bbf5e0-2f6b-4818-bf4d-00117c41a647 req-f1aa353b-26ec-4f7a-afa7-d7a6ca6de361 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030071 Feb 28 10:38:17.503321 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 429/821] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:38:17.525085 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-a09911f7-19da-4676-bca0-6a7bc5bfafc3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lazy-loading 'services' on Instance uuid c9afa739-da2b-478b-af9a-7ea5ad86650d {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:38:17.597416 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a09911f7-19da-4676-bca0-6a7bc5bfafc3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments/03bcd47d-60a0-4381-aedc-6829a20774fc" status: 202 len: 0 microversion: 2.1 time: 0.162135 Feb 28 10:38:17.598039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 393/822] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:38:17 2022] DELETE /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments/03bcd47d-60a0-4381-aedc-6829a20774fc => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:38:17.606921 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-35fdff7a-d1e4-4280-b525-9b368f16aca3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:17.608079 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-35fdff7a-d1e4-4280-b525-9b368f16aca3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:17.614378 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-35fdff7a-d1e4-4280-b525-9b368f16aca3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:17.614890 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-35fdff7a-d1e4-4280-b525-9b368f16aca3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.615674 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-35fdff7a-d1e4-4280-b525-9b368f16aca3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:17.616099 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-35fdff7a-d1e4-4280-b525-9b368f16aca3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:17.645229 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-35fdff7a-d1e4-4280-b525-9b368f16aca3 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042548 Feb 28 10:38:17.645698 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 430/823] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:38:17 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:18.151914 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b143406c-48f0-4919-b21c-812f9a627cf2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:18.152657 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b143406c-48f0-4919-b21c-812f9a627cf2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:18.159550 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b143406c-48f0-4919-b21c-812f9a627cf2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:18.159995 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b143406c-48f0-4919-b21c-812f9a627cf2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:18.160908 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b143406c-48f0-4919-b21c-812f9a627cf2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:18.161344 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b143406c-48f0-4919-b21c-812f9a627cf2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:18.293624 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b143406c-48f0-4919-b21c-812f9a627cf2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:18.301564 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b143406c-48f0-4919-b21c-812f9a627cf2 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1577 microversion: 2.1 time: 0.155156 Feb 28 10:38:18.302116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 394/824] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:18 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:18.657361 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3fa23dee-624f-4fd2-a598-ceb69805f575 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:18.658270 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3fa23dee-624f-4fd2-a598-ceb69805f575 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:18.664538 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fa23dee-624f-4fd2-a598-ceb69805f575 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:18.664985 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fa23dee-624f-4fd2-a598-ceb69805f575 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:18.665766 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fa23dee-624f-4fd2-a598-ceb69805f575 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:18.666199 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fa23dee-624f-4fd2-a598-ceb69805f575 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:18.694473 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3fa23dee-624f-4fd2-a598-ceb69805f575 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041597 Feb 28 10:38:18.695058 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 431/825] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:38:18 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:19.318885 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-31bf9136-4153-4abc-910f-4854c50f4d1d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:19.319498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-31bf9136-4153-4abc-910f-4854c50f4d1d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:19.325804 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-31bf9136-4153-4abc-910f-4854c50f4d1d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:19.326953 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-31bf9136-4153-4abc-910f-4854c50f4d1d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:19.327843 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-31bf9136-4153-4abc-910f-4854c50f4d1d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:19.328255 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-31bf9136-4153-4abc-910f-4854c50f4d1d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:19.462656 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-31bf9136-4153-4abc-910f-4854c50f4d1d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:19.470029 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-31bf9136-4153-4abc-910f-4854c50f4d1d tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1564 microversion: 2.1 time: 0.155054 Feb 28 10:38:19.470887 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 395/826] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:19 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:19.705761 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c22d0446-1add-4bcc-be74-5de386109c6c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:19.706642 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c22d0446-1add-4bcc-be74-5de386109c6c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:19.712870 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c22d0446-1add-4bcc-be74-5de386109c6c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:19.713316 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c22d0446-1add-4bcc-be74-5de386109c6c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:19.714090 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c22d0446-1add-4bcc-be74-5de386109c6c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:19.714523 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c22d0446-1add-4bcc-be74-5de386109c6c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:19.742669 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c22d0446-1add-4bcc-be74-5de386109c6c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041049 Feb 28 10:38:19.743211 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 432/827] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:38:19 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 10:38:19.842294 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-171918829", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "networks": [{"uuid": "385c32c8-9d90-44b6-bcc3-678e48a38bb6"}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:19.892681 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] validate_networks() for [('385c32c8-9d90-44b6-bcc3-678e48a38bb6', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:38:20.263623 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:38:20.264041 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:38:20.264512 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:38:20.264943 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:38:20.265348 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:38:20.275337 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:20.275834 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:20.276765 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:20.277251 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:20.294441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Getting quotas for project 5c79b1decd974ef2bb73bf55edc02f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:38:20.298775 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Getting quotas for user 3cdcba6d332b492196494db46ced8b9f and project 5c79b1decd974ef2bb73bf55edc02f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:38:20.309981 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:38:20.312849 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:38:20.356848 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8c1743b6-b2a3-4a85-8a79-839ce91674ed tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518664 Feb 28 10:38:20.358297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 396/828] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:38:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:38:20.367224 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-29bf5b69-82da-4ba8-9adf-96cda6d24623 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:20.367839 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-29bf5b69-82da-4ba8-9adf-96cda6d24623 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:20.420752 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-29bf5b69-82da-4ba8-9adf-96cda6d24623 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:20.427190 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-29bf5b69-82da-4ba8-9adf-96cda6d24623 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1217 microversion: 2.1 time: 0.063766 Feb 28 10:38:20.427751 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 433/829] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:20 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:21.444687 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-26669273-8642-416b-b4d1-f105434240ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:21.445295 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-26669273-8642-416b-b4d1-f105434240ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:21.452533 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26669273-8642-416b-b4d1-f105434240ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:21.452990 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26669273-8642-416b-b4d1-f105434240ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:21.453783 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26669273-8642-416b-b4d1-f105434240ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:21.454223 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26669273-8642-416b-b4d1-f105434240ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:21.516664 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-26669273-8642-416b-b4d1-f105434240ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:21.524032 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-26669273-8642-416b-b4d1-f105434240ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1277 microversion: 2.1 time: 0.083655 Feb 28 10:38:21.524919 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 397/830] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:21 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:22.542938 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-31aa41a4-74b5-406c-beb1-4f7163b3b273 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:22.543559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-31aa41a4-74b5-406c-beb1-4f7163b3b273 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:22.550687 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-31aa41a4-74b5-406c-beb1-4f7163b3b273 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:22.551140 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-31aa41a4-74b5-406c-beb1-4f7163b3b273 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:22.552257 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-31aa41a4-74b5-406c-beb1-4f7163b3b273 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:22.552696 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-31aa41a4-74b5-406c-beb1-4f7163b3b273 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:22.687033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-31aa41a4-74b5-406c-beb1-4f7163b3b273 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:22.694695 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-31aa41a4-74b5-406c-beb1-4f7163b3b273 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1317 microversion: 2.1 time: 0.155706 Feb 28 10:38:22.695265 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 434/831] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:22 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:38:22.756645 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-121e9b94-2726-4503-9b2e-acd450f2ff6c req-306ec30a-1e1f-4e82-86f9-b56c54d63b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c77b1c-69c1-4483-aa2d-3a097096ff04", "tag": "fc7add66-658c-4fc8-b830-725fe0ddd217"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:22.768343 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-121e9b94-2726-4503-9b2e-acd450f2ff6c req-306ec30a-1e1f-4e82-86f9-b56c54d63b09 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:22.769047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-121e9b94-2726-4503-9b2e-acd450f2ff6c req-306ec30a-1e1f-4e82-86f9-b56c54d63b09 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:22.781330 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-121e9b94-2726-4503-9b2e-acd450f2ff6c req-306ec30a-1e1f-4e82-86f9-b56c54d63b09 service nova] Creating event network-changed:fc7add66-658c-4fc8-b830-725fe0ddd217 for instance f4c77b1c-69c1-4483-aa2d-3a097096ff04 on hv-cinder-maste Feb 28 10:38:22.786098 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-121e9b94-2726-4503-9b2e-acd450f2ff6c req-306ec30a-1e1f-4e82-86f9-b56c54d63b09 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033415 Feb 28 10:38:22.786703 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 398/832] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:23.712437 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-84593f73-9513-4f7a-a6b8-0cc8bf940024 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:23.713043 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-84593f73-9513-4f7a-a6b8-0cc8bf940024 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:23.720471 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-84593f73-9513-4f7a-a6b8-0cc8bf940024 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:23.721176 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-84593f73-9513-4f7a-a6b8-0cc8bf940024 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:23.721961 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-84593f73-9513-4f7a-a6b8-0cc8bf940024 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:23.722396 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-84593f73-9513-4f7a-a6b8-0cc8bf940024 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:23.860284 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-84593f73-9513-4f7a-a6b8-0cc8bf940024 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:23.867497 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-84593f73-9513-4f7a-a6b8-0cc8bf940024 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1317 microversion: 2.1 time: 0.158848 Feb 28 10:38:23.868056 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 435/833] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:23 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:24.884494 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d271f536-489d-4495-b18e-84a9b9a6005f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:24.885314 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d271f536-489d-4495-b18e-84a9b9a6005f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:24.892611 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d271f536-489d-4495-b18e-84a9b9a6005f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:24.893057 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d271f536-489d-4495-b18e-84a9b9a6005f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:24.893827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d271f536-489d-4495-b18e-84a9b9a6005f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:24.894255 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d271f536-489d-4495-b18e-84a9b9a6005f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:25.028079 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d271f536-489d-4495-b18e-84a9b9a6005f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:25.036254 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d271f536-489d-4495-b18e-84a9b9a6005f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1317 microversion: 2.1 time: 0.156507 Feb 28 10:38:25.036847 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 399/834] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:24 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:26.054534 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b92608c4-5b3c-471f-9584-6ce7eedb631f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:26.055182 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b92608c4-5b3c-471f-9584-6ce7eedb631f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:26.062167 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b92608c4-5b3c-471f-9584-6ce7eedb631f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:26.062634 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b92608c4-5b3c-471f-9584-6ce7eedb631f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:26.063488 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b92608c4-5b3c-471f-9584-6ce7eedb631f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:26.063918 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b92608c4-5b3c-471f-9584-6ce7eedb631f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:26.201716 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b92608c4-5b3c-471f-9584-6ce7eedb631f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:26.209118 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b92608c4-5b3c-471f-9584-6ce7eedb631f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1317 microversion: 2.1 time: 0.158588 Feb 28 10:38:26.209674 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 436/835] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:26 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:27.228403 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2a97a246-4130-421b-9cdf-971fc312a93f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:27.229014 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2a97a246-4130-421b-9cdf-971fc312a93f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:27.237505 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2a97a246-4130-421b-9cdf-971fc312a93f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:27.238159 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2a97a246-4130-421b-9cdf-971fc312a93f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:27.238972 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2a97a246-4130-421b-9cdf-971fc312a93f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:27.239406 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2a97a246-4130-421b-9cdf-971fc312a93f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:27.374040 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2a97a246-4130-421b-9cdf-971fc312a93f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:27.381864 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2a97a246-4130-421b-9cdf-971fc312a93f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1317 microversion: 2.1 time: 0.157429 Feb 28 10:38:27.382437 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 400/836] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:27 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:28.399016 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c0ebf147-c591-4c8d-9332-7079f91c0d6d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:28.399677 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c0ebf147-c591-4c8d-9332-7079f91c0d6d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:28.406587 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c0ebf147-c591-4c8d-9332-7079f91c0d6d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:28.407060 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c0ebf147-c591-4c8d-9332-7079f91c0d6d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:28.407841 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c0ebf147-c591-4c8d-9332-7079f91c0d6d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:28.408281 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c0ebf147-c591-4c8d-9332-7079f91c0d6d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:28.540018 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c0ebf147-c591-4c8d-9332-7079f91c0d6d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:28.548426 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c0ebf147-c591-4c8d-9332-7079f91c0d6d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1317 microversion: 2.1 time: 0.153315 Feb 28 10:38:28.548986 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 437/837] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:28 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:29.375950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-581ab838-9079-4360-9fe4-33aa9701cb51 req-dfd07d89-f60f-471a-b8ee-4167b6d8825a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c77b1c-69c1-4483-aa2d-3a097096ff04", "name": "network-vif-plugged", "status": "completed", "tag": "fc7add66-658c-4fc8-b830-725fe0ddd217"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:29.384858 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-581ab838-9079-4360-9fe4-33aa9701cb51 req-dfd07d89-f60f-471a-b8ee-4167b6d8825a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:29.385904 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-581ab838-9079-4360-9fe4-33aa9701cb51 req-dfd07d89-f60f-471a-b8ee-4167b6d8825a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:29.397461 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-581ab838-9079-4360-9fe4-33aa9701cb51 req-dfd07d89-f60f-471a-b8ee-4167b6d8825a service nova] Creating event network-vif-plugged:fc7add66-658c-4fc8-b830-725fe0ddd217 for instance f4c77b1c-69c1-4483-aa2d-3a097096ff04 on hv-cinder-maste Feb 28 10:38:29.402220 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-581ab838-9079-4360-9fe4-33aa9701cb51 req-dfd07d89-f60f-471a-b8ee-4167b6d8825a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030007 Feb 28 10:38:29.403039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 401/838] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:29.564287 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-a17bc108-b1bb-467c-9cd0-119d3b09a64b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:29.564920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-a17bc108-b1bb-467c-9cd0-119d3b09a64b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:29.571228 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a17bc108-b1bb-467c-9cd0-119d3b09a64b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:29.571681 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a17bc108-b1bb-467c-9cd0-119d3b09a64b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:29.572462 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a17bc108-b1bb-467c-9cd0-119d3b09a64b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:29.572895 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-a17bc108-b1bb-467c-9cd0-119d3b09a64b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:29.709938 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-a17bc108-b1bb-467c-9cd0-119d3b09a64b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:29.717832 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-a17bc108-b1bb-467c-9cd0-119d3b09a64b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1317 microversion: 2.1 time: 0.157415 Feb 28 10:38:29.718383 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 438/839] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:29 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:30.735913 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6c11871f-53b4-4b76-99d4-bc244ce13079 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:30.736616 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6c11871f-53b4-4b76-99d4-bc244ce13079 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:30.743162 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6c11871f-53b4-4b76-99d4-bc244ce13079 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:30.743626 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6c11871f-53b4-4b76-99d4-bc244ce13079 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:30.744384 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6c11871f-53b4-4b76-99d4-bc244ce13079 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:30.744819 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6c11871f-53b4-4b76-99d4-bc244ce13079 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:30.878359 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6c11871f-53b4-4b76-99d4-bc244ce13079 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:30.885712 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6c11871f-53b4-4b76-99d4-bc244ce13079 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1317 microversion: 2.1 time: 0.154688 Feb 28 10:38:30.886273 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 402/840] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:30 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:31.903388 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2b3fcf79-576b-4a3c-a7ca-a1dc44ee5272 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:31.904004 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2b3fcf79-576b-4a3c-a7ca-a1dc44ee5272 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:31.910295 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2b3fcf79-576b-4a3c-a7ca-a1dc44ee5272 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:31.910783 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2b3fcf79-576b-4a3c-a7ca-a1dc44ee5272 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:31.911558 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2b3fcf79-576b-4a3c-a7ca-a1dc44ee5272 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:31.911996 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2b3fcf79-576b-4a3c-a7ca-a1dc44ee5272 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:32.046884 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2b3fcf79-576b-4a3c-a7ca-a1dc44ee5272 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:32.053994 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2b3fcf79-576b-4a3c-a7ca-a1dc44ee5272 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1507 microversion: 2.1 time: 0.154508 Feb 28 10:38:32.054553 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 439/841] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:31 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:33.366100 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d175368d-a808-49e5-b200-c61635d8a776 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52fc98c6-48b0-4790-b728-655d1b6f1e1d"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:33.367181 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d175368d-a808-49e5-b200-c61635d8a776 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:33.373372 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d175368d-a808-49e5-b200-c61635d8a776 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:33.373813 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d175368d-a808-49e5-b200-c61635d8a776 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:33.374578 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d175368d-a808-49e5-b200-c61635d8a776 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:33.375033 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d175368d-a808-49e5-b200-c61635d8a776 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:33.652600 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d175368d-a808-49e5-b200-c61635d8a776 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "POST /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290209 Feb 28 10:38:33.653199 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 403/842] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:38:33 2022] POST /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:41.126995 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-590f0c14-d80b-4b07-a2a9-ec3dbd9d7dbf tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52fc98c6-48b0-4790-b728-655d1b6f1e1d"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:41.128070 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-590f0c14-d80b-4b07-a2a9-ec3dbd9d7dbf tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:41.134333 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-590f0c14-d80b-4b07-a2a9-ec3dbd9d7dbf tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:41.134824 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-590f0c14-d80b-4b07-a2a9-ec3dbd9d7dbf tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:41.135608 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-590f0c14-d80b-4b07-a2a9-ec3dbd9d7dbf tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:41.136051 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-590f0c14-d80b-4b07-a2a9-ec3dbd9d7dbf tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:41.210882 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-590f0c14-d80b-4b07-a2a9-ec3dbd9d7dbf tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] HTTP exception thrown: Invalid volume: volume 52fc98c6-48b0-4790-b728-655d1b6f1e1d is already attached to instances: f4c77b1c-69c1-4483-aa2d-3a097096ff04 Feb 28 10:38:41.211489 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-590f0c14-d80b-4b07-a2a9-ec3dbd9d7dbf tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Returning 400 to user: Invalid volume: volume 52fc98c6-48b0-4790-b728-655d1b6f1e1d is already attached to instances: f4c77b1c-69c1-4483-aa2d-3a097096ff04 {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:38:41.212347 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-590f0c14-d80b-4b07-a2a9-ec3dbd9d7dbf tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "POST /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089562 Feb 28 10:38:41.212883 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 440/843] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:38:41 2022] POST /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 28 10:38:41.272940 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ebf9e3e7-4bc4-4541-bf6d-d654c9313f25 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:41.273529 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ebf9e3e7-4bc4-4541-bf6d-d654c9313f25 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:41.280054 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ebf9e3e7-4bc4-4541-bf6d-d654c9313f25 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:41.280586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ebf9e3e7-4bc4-4541-bf6d-d654c9313f25 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:41.281375 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ebf9e3e7-4bc4-4541-bf6d-d654c9313f25 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:41.281814 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ebf9e3e7-4bc4-4541-bf6d-d654c9313f25 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:41.358191 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-ebf9e3e7-4bc4-4541-bf6d-d654c9313f25 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lazy-loading 'services' on Instance uuid f4c77b1c-69c1-4483-aa2d-3a097096ff04 {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:38:41.426775 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ebf9e3e7-4bc4-4541-bf6d-d654c9313f25 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments/52fc98c6-48b0-4790-b728-655d1b6f1e1d" status: 202 len: 0 microversion: 2.1 time: 0.159723 Feb 28 10:38:41.427701 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 404/844] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:38:41 2022] DELETE /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments/52fc98c6-48b0-4790-b728-655d1b6f1e1d => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:38:41.436819 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3620dca3-6303-4d1f-8946-154f6259c5d6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:41.437746 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3620dca3-6303-4d1f-8946-154f6259c5d6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:41.443665 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3620dca3-6303-4d1f-8946-154f6259c5d6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:41.444210 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3620dca3-6303-4d1f-8946-154f6259c5d6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:41.445013 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3620dca3-6303-4d1f-8946-154f6259c5d6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:41.445455 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3620dca3-6303-4d1f-8946-154f6259c5d6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:41.475027 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3620dca3-6303-4d1f-8946-154f6259c5d6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042858 Feb 28 10:38:41.475575 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 441/845] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:38:41 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:42.487341 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b1ad5195-e404-40cf-bed9-2e8ed93c7055 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:42.488560 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b1ad5195-e404-40cf-bed9-2e8ed93c7055 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:42.495637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1ad5195-e404-40cf-bed9-2e8ed93c7055 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:42.496081 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1ad5195-e404-40cf-bed9-2e8ed93c7055 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:42.496861 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1ad5195-e404-40cf-bed9-2e8ed93c7055 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:42.497291 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1ad5195-e404-40cf-bed9-2e8ed93c7055 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:42.528330 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b1ad5195-e404-40cf-bed9-2e8ed93c7055 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045197 Feb 28 10:38:42.530067 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 405/846] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:38:42 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 10:38:42.627647 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-41500900", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "networks": [{"uuid": "385c32c8-9d90-44b6-bcc3-678e48a38bb6"}]}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:42.679941 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.network.neutron [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] validate_networks() for [('385c32c8-9d90-44b6-bcc3-678e48a38bb6', None, None, None, None, None)] {{(pid=123152) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:38:43.134428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Flavor limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:38:43.134428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Image limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:38:43.134428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Flavor pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:38:43.134428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Image pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:38:43.134428 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:38:43.143091 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:43.143542 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:43.144369 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:43.144835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:43.161990 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Getting quotas for project 5c79b1decd974ef2bb73bf55edc02f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:38:43.166263 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Getting quotas for user 3cdcba6d332b492196494db46ced8b9f and project 5c79b1decd974ef2bb73bf55edc02f8c. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:38:43.182030 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Going to run 1 instances... {{(pid=123152) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:38:43.184517 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:38:43.240515 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1519a99b-0911-468e-83e2-6df264158d3b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617820 Feb 28 10:38:43.241159 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 442/847] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:38:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:38:43.252141 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8a893ab3-ecac-4579-80b2-65289df32928 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:43.252771 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8a893ab3-ecac-4579-80b2-65289df32928 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:43.310471 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8a893ab3-ecac-4579-80b2-65289df32928 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:43.317183 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8a893ab3-ecac-4579-80b2-65289df32928 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1216 microversion: 2.1 time: 0.069997 Feb 28 10:38:43.317764 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 406/848] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:43 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:44.158147 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3fa2e0cc-95cb-4519-ac70-3343b04bb434 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:44.159256 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3fa2e0cc-95cb-4519-ac70-3343b04bb434 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:44.165290 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fa2e0cc-95cb-4519-ac70-3343b04bb434 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:44.165736 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fa2e0cc-95cb-4519-ac70-3343b04bb434 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:44.166520 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fa2e0cc-95cb-4519-ac70-3343b04bb434 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:44.167025 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3fa2e0cc-95cb-4519-ac70-3343b04bb434 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:44.200124 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3fa2e0cc-95cb-4519-ac70-3343b04bb434 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046062 Feb 28 10:38:44.201760 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 443/849] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Feb 28 10:38:44 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:44.259495 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b1174cb6-838b-4ba6-84ae-c8a537d00735 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:44.260007 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b1174cb6-838b-4ba6-84ae-c8a537d00735 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:44.268625 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1174cb6-838b-4ba6-84ae-c8a537d00735 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:44.269083 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1174cb6-838b-4ba6-84ae-c8a537d00735 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:44.269870 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1174cb6-838b-4ba6-84ae-c8a537d00735 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:44.270317 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b1174cb6-838b-4ba6-84ae-c8a537d00735 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:44.293898 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b1174cb6-838b-4ba6-84ae-c8a537d00735 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Going to try to terminate instance {{(pid=123151) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:38:44.339221 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8b5fbfa6-c610-4280-af29-6d967aa98f0f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:44.339867 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8b5fbfa6-c610-4280-af29-6d967aa98f0f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:44.348033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8b5fbfa6-c610-4280-af29-6d967aa98f0f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:44.348485 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8b5fbfa6-c610-4280-af29-6d967aa98f0f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:44.349283 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8b5fbfa6-c610-4280-af29-6d967aa98f0f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:44.349722 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8b5fbfa6-c610-4280-af29-6d967aa98f0f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:44.371895 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b1174cb6-838b-4ba6-84ae-c8a537d00735 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 204 len: 0 microversion: 2.20 time: 0.116008 Feb 28 10:38:44.372401 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 407/850] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Feb 28 10:38:44 2022] DELETE /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 28 10:38:44.381239 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:44.382008 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:44.389012 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:44.389781 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:44.390867 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:44.390867 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:44.413922 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8b5fbfa6-c610-4280-af29-6d967aa98f0f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:44.421466 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8b5fbfa6-c610-4280-af29-6d967aa98f0f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1276 microversion: 2.1 time: 0.086102 Feb 28 10:38:44.431059 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 444/851] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:44 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:38:44.544339 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:44.552792 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:44.554724 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:44.555426 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-33ab2307-a084-455a-9264-0a95ba4011c6 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.178746 Feb 28 10:38:44.566484 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 408/852] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:44 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:38:45.439038 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c570728e-0874-4448-8cb2-8888b2f3dc40 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:45.439750 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c570728e-0874-4448-8cb2-8888b2f3dc40 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:45.446029 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c570728e-0874-4448-8cb2-8888b2f3dc40 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:45.446555 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c570728e-0874-4448-8cb2-8888b2f3dc40 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:45.447448 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c570728e-0874-4448-8cb2-8888b2f3dc40 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:45.448111 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c570728e-0874-4448-8cb2-8888b2f3dc40 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:45.574133 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:45.575215 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:45.583655 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:45.584217 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:45.585270 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:45.585712 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:45.589083 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c570728e-0874-4448-8cb2-8888b2f3dc40 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:45.597519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c570728e-0874-4448-8cb2-8888b2f3dc40 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1316 microversion: 2.1 time: 0.163511 Feb 28 10:38:45.598170 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 445/853] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:45 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:45.718680 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-832cb9e5-bb21-4ea2-afa3-87108658e614 req-ec2ab1c6-8ddd-48d7-a439-22a8c7945373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94d0be3-19c9-4062-b71e-076350459b4c", "tag": "73d4538a-af6f-4c0f-a3f8-5937a632c3c4"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:45.726417 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:45.728265 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-832cb9e5-bb21-4ea2-afa3-87108658e614 req-ec2ab1c6-8ddd-48d7-a439-22a8c7945373 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:45.728891 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-832cb9e5-bb21-4ea2-afa3-87108658e614 req-ec2ab1c6-8ddd-48d7-a439-22a8c7945373 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:45.740591 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:45.742572 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:45.743972 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2cd96e2b-3bca-4fb0-9cec-942fbf1935ee tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.174565 Feb 28 10:38:45.744093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-832cb9e5-bb21-4ea2-afa3-87108658e614 req-ec2ab1c6-8ddd-48d7-a439-22a8c7945373 service nova] Creating event network-changed:73d4538a-af6f-4c0f-a3f8-5937a632c3c4 for instance a94d0be3-19c9-4062-b71e-076350459b4c on hv-cinder-maste Feb 28 10:38:45.744708 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 409/854] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:45 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 10:38:45.750473 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-832cb9e5-bb21-4ea2-afa3-87108658e614 req-ec2ab1c6-8ddd-48d7-a439-22a8c7945373 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035789 Feb 28 10:38:45.751098 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 446/855] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:38:46.616138 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-74cfee9d-0338-4cb4-80c6-f994716e7e2d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:46.616889 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-74cfee9d-0338-4cb4-80c6-f994716e7e2d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:46.624498 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74cfee9d-0338-4cb4-80c6-f994716e7e2d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:46.624979 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74cfee9d-0338-4cb4-80c6-f994716e7e2d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:46.625760 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74cfee9d-0338-4cb4-80c6-f994716e7e2d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:46.626250 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74cfee9d-0338-4cb4-80c6-f994716e7e2d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:46.764782 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:46.765381 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:46.771985 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:46.772855 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:46.773645 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:46.774232 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:47.144749 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-74cfee9d-0338-4cb4-80c6-f994716e7e2d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:47.151935 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-74cfee9d-0338-4cb4-80c6-f994716e7e2d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1316 microversion: 2.1 time: 0.541307 Feb 28 10:38:47.152522 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 410/856] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:46 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:47.283385 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:47.291998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:47.293477 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:47.294953 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8d3e5455-6a3f-4070-8552-3a6d791b392e tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1725 microversion: 2.20 time: 0.535259 Feb 28 10:38:47.295821 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 447/857] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:46 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1725 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:38:47.922177 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-4ec05258-6b72-464a-be1d-b55bed134304 req-133e445c-d135-4f18-9ca5-e6e1fa96084b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d16ba15-2ef6-4ce9-a9cd-d5e14657271a", "name": "network-vif-deleted", "tag": "c091db1b-3683-4633-8290-5a1701243cc7"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:47.931042 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-4ec05258-6b72-464a-be1d-b55bed134304 req-133e445c-d135-4f18-9ca5-e6e1fa96084b service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:47.931479 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-4ec05258-6b72-464a-be1d-b55bed134304 req-133e445c-d135-4f18-9ca5-e6e1fa96084b service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:47.943587 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-4ec05258-6b72-464a-be1d-b55bed134304 req-133e445c-d135-4f18-9ca5-e6e1fa96084b service nova] Creating event network-vif-deleted:c091db1b-3683-4633-8290-5a1701243cc7 for instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a on hv-cinder-maste Feb 28 10:38:47.949273 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-4ec05258-6b72-464a-be1d-b55bed134304 req-133e445c-d135-4f18-9ca5-e6e1fa96084b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030947 Feb 28 10:38:47.950074 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 411/858] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:48.168911 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-71076c41-a904-49f4-9167-41c9f0ba8e5d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:48.170050 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-71076c41-a904-49f4-9167-41c9f0ba8e5d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:48.177208 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-71076c41-a904-49f4-9167-41c9f0ba8e5d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:48.177654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-71076c41-a904-49f4-9167-41c9f0ba8e5d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:48.178425 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-71076c41-a904-49f4-9167-41c9f0ba8e5d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:48.178884 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-71076c41-a904-49f4-9167-41c9f0ba8e5d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:48.315234 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:48.315932 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:48.316788 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-71076c41-a904-49f4-9167-41c9f0ba8e5d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:48.322369 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:48.322838 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:48.323623 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:48.324240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:48.324584 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-71076c41-a904-49f4-9167-41c9f0ba8e5d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1316 microversion: 2.1 time: 0.159546 Feb 28 10:38:48.325638 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 448/859] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:48 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:48.355794 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:48.356238 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:48.356683 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lazy-loading 'fault' on Instance uuid 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:38:48.400549 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:48.408381 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:48.409893 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da9524bba20140f694ac7cd6e8f37038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003233ff59254fa88847f9adc1437df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:48.411080 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3398cffe-3a2d-4fd9-aa6a-5b4ade915800 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 200 len: 1371 microversion: 2.20 time: 0.101747 Feb 28 10:38:48.411642 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 412/860] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:48 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 10:38:49.342407 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-01dcc44b-3bb0-4cc9-91d8-3aef9dc93900 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:49.343152 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-01dcc44b-3bb0-4cc9-91d8-3aef9dc93900 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:49.350044 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-01dcc44b-3bb0-4cc9-91d8-3aef9dc93900 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:49.350488 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-01dcc44b-3bb0-4cc9-91d8-3aef9dc93900 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:49.351302 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-01dcc44b-3bb0-4cc9-91d8-3aef9dc93900 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:49.351741 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-01dcc44b-3bb0-4cc9-91d8-3aef9dc93900 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:49.429384 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5b3df611-6a49-4fcd-b45d-3a9cd9801fff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:49.430047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-5b3df611-6a49-4fcd-b45d-3a9cd9801fff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:49.437090 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5b3df611-6a49-4fcd-b45d-3a9cd9801fff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:49.437539 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5b3df611-6a49-4fcd-b45d-3a9cd9801fff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:49.438332 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5b3df611-6a49-4fcd-b45d-3a9cd9801fff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:49.438831 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-5b3df611-6a49-4fcd-b45d-3a9cd9801fff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:49.454307 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-5b3df611-6a49-4fcd-b45d-3a9cd9801fff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] HTTP exception thrown: Instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a could not be found. Feb 28 10:38:49.454932 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-5b3df611-6a49-4fcd-b45d-3a9cd9801fff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Returning 404 to user: Instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:38:49.455795 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-5b3df611-6a49-4fcd-b45d-3a9cd9801fff tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 404 len: 111 microversion: 2.20 time: 0.030361 Feb 28 10:38:49.456550 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 413/861] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:49 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 28 10:38:49.464783 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6dd17492-e032-408e-8d59-748e376406dd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '.version_select at 0x7f1c580c54c0>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:49.484807 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6dd17492-e032-408e-8d59-748e376406dd tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386347708" status: 204 len: 0 microversion: 2.20 time: 0.023942 Feb 28 10:38:49.485378 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 414/862] 10.222.0.21 () {60 vars in 1261 bytes} [Mon Feb 28 10:38:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386347708 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 28 10:38:49.494070 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-01dcc44b-3bb0-4cc9-91d8-3aef9dc93900 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:49.501662 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-01dcc44b-3bb0-4cc9-91d8-3aef9dc93900 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1316 microversion: 2.1 time: 0.163814 Feb 28 10:38:49.502541 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 449/863] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:49 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:50.518669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e6aec420-11e7-48ef-98c6-ac167acb1d4f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:50.519357 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e6aec420-11e7-48ef-98c6-ac167acb1d4f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:50.525224 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e6aec420-11e7-48ef-98c6-ac167acb1d4f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:50.525673 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e6aec420-11e7-48ef-98c6-ac167acb1d4f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:50.526456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e6aec420-11e7-48ef-98c6-ac167acb1d4f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:50.526939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e6aec420-11e7-48ef-98c6-ac167acb1d4f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:50.664283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e6aec420-11e7-48ef-98c6-ac167acb1d4f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:50.672000 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e6aec420-11e7-48ef-98c6-ac167acb1d4f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1316 microversion: 2.1 time: 0.158369 Feb 28 10:38:50.672553 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 415/864] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:50 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:51.235030 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-476f44a1-9a09-4d86-aa6c-6f4b179b5456 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:51.235518 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-476f44a1-9a09-4d86-aa6c-6f4b179b5456 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:51.241690 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-476f44a1-9a09-4d86-aa6c-6f4b179b5456 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:51.242148 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-476f44a1-9a09-4d86-aa6c-6f4b179b5456 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:51.242947 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-476f44a1-9a09-4d86-aa6c-6f4b179b5456 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:51.243387 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-476f44a1-9a09-4d86-aa6c-6f4b179b5456 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:51.256155 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-476f44a1-9a09-4d86-aa6c-6f4b179b5456 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] HTTP exception thrown: Instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a could not be found. Feb 28 10:38:51.256737 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-476f44a1-9a09-4d86-aa6c-6f4b179b5456 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Returning 404 to user: Instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:38:51.257536 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-476f44a1-9a09-4d86-aa6c-6f4b179b5456 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 404 len: 111 microversion: 2.20 time: 0.026495 Feb 28 10:38:51.258049 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 450/865] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Feb 28 10:38:51 2022] DELETE /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 10:38:51.266377 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8ec46bc9-0524-4d04-9df7-2c9dd6f4f7a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:51.267021 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8ec46bc9-0524-4d04-9df7-2c9dd6f4f7a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:51.272781 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8ec46bc9-0524-4d04-9df7-2c9dd6f4f7a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:51.273231 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8ec46bc9-0524-4d04-9df7-2c9dd6f4f7a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:51.274006 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8ec46bc9-0524-4d04-9df7-2c9dd6f4f7a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:51.274443 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8ec46bc9-0524-4d04-9df7-2c9dd6f4f7a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:51.288173 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-8ec46bc9-0524-4d04-9df7-2c9dd6f4f7a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] HTTP exception thrown: Instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a could not be found. Feb 28 10:38:51.288758 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8ec46bc9-0524-4d04-9df7-2c9dd6f4f7a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Returning 404 to user: Instance 6d16ba15-2ef6-4ce9-a9cd-d5e14657271a could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:38:51.289602 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8ec46bc9-0524-4d04-9df7-2c9dd6f4f7a9 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a" status: 404 len: 111 microversion: 2.20 time: 0.027723 Feb 28 10:38:51.290124 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 416/866] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:51 2022] GET /compute/v2.1/servers/6d16ba15-2ef6-4ce9-a9cd-d5e14657271a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 10:38:51.469793 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-282c453a-e5a9-4bc4-9165-53e7c342d0de req-b592f34d-aaa9-4c06-9b80-296f6c83fe8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94d0be3-19c9-4062-b71e-076350459b4c", "name": "network-vif-plugged", "status": "completed", "tag": "73d4538a-af6f-4c0f-a3f8-5937a632c3c4"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:51.477759 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-282c453a-e5a9-4bc4-9165-53e7c342d0de req-b592f34d-aaa9-4c06-9b80-296f6c83fe8f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:51.478231 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-282c453a-e5a9-4bc4-9165-53e7c342d0de req-b592f34d-aaa9-4c06-9b80-296f6c83fe8f service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:51.489597 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-282c453a-e5a9-4bc4-9165-53e7c342d0de req-b592f34d-aaa9-4c06-9b80-296f6c83fe8f service nova] Creating event network-vif-plugged:73d4538a-af6f-4c0f-a3f8-5937a632c3c4 for instance a94d0be3-19c9-4062-b71e-076350459b4c on hv-cinder-maste Feb 28 10:38:51.494442 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-282c453a-e5a9-4bc4-9165-53e7c342d0de req-b592f34d-aaa9-4c06-9b80-296f6c83fe8f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029630 Feb 28 10:38:51.495286 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 451/867] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:38:51.689616 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-96504e38-8708-4998-9c5a-3f83369b77f5 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:51.690440 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-96504e38-8708-4998-9c5a-3f83369b77f5 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:51.696655 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-96504e38-8708-4998-9c5a-3f83369b77f5 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:51.697102 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-96504e38-8708-4998-9c5a-3f83369b77f5 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:51.697885 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-96504e38-8708-4998-9c5a-3f83369b77f5 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:51.698314 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-96504e38-8708-4998-9c5a-3f83369b77f5 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:51.870971 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-96504e38-8708-4998-9c5a-3f83369b77f5 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:51.878776 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-96504e38-8708-4998-9c5a-3f83369b77f5 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1316 microversion: 2.1 time: 0.194016 Feb 28 10:38:51.879326 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 417/868] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:51 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:52.422999 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-27b7f30d-fd1e-4f17-b216-afaf38e16279 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:52.423583 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-27b7f30d-fd1e-4f17-b216-afaf38e16279 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:52.429596 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-27b7f30d-fd1e-4f17-b216-afaf38e16279 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:52.430042 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-27b7f30d-fd1e-4f17-b216-afaf38e16279 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:52.430854 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-27b7f30d-fd1e-4f17-b216-afaf38e16279 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:52.431291 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-27b7f30d-fd1e-4f17-b216-afaf38e16279 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:52.444538 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-27b7f30d-fd1e-4f17-b216-afaf38e16279 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] HTTP exception thrown: Instance 1ead279e-e2e9-4312-a47a-fbec064ce99b could not be found. Feb 28 10:38:52.445113 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-27b7f30d-fd1e-4f17-b216-afaf38e16279 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Returning 404 to user: Instance 1ead279e-e2e9-4312-a47a-fbec064ce99b could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:38:52.445911 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-27b7f30d-fd1e-4f17-b216-afaf38e16279 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 404 len: 111 microversion: 2.20 time: 0.027877 Feb 28 10:38:52.446427 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 452/869] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Feb 28 10:38:52 2022] DELETE /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 10:38:52.454882 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8f78c22f-e102-4cd4-975f-1d938e84c529 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:52.455525 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8f78c22f-e102-4cd4-975f-1d938e84c529 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] [instance: 1ead279e-e2e9-4312-a47a-fbec064ce99b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:52.461591 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8f78c22f-e102-4cd4-975f-1d938e84c529 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:52.462043 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8f78c22f-e102-4cd4-975f-1d938e84c529 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:52.462850 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8f78c22f-e102-4cd4-975f-1d938e84c529 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:52.463284 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8f78c22f-e102-4cd4-975f-1d938e84c529 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:52.476241 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-8f78c22f-e102-4cd4-975f-1d938e84c529 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] HTTP exception thrown: Instance 1ead279e-e2e9-4312-a47a-fbec064ce99b could not be found. Feb 28 10:38:52.476826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8f78c22f-e102-4cd4-975f-1d938e84c529 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] Returning 404 to user: Instance 1ead279e-e2e9-4312-a47a-fbec064ce99b could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:38:52.477629 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8f78c22f-e102-4cd4-975f-1d938e84c529 tempest-AttachVolumeShelveTestJSON-14373286 tempest-AttachVolumeShelveTestJSON-14373286-project] 10.222.0.21 "GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b" status: 404 len: 111 microversion: 2.20 time: 0.027332 Feb 28 10:38:52.478154 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 418/870] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 10:38:52 2022] GET /compute/v2.1/servers/1ead279e-e2e9-4312-a47a-fbec064ce99b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 10:38:52.895579 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-820cac1b-bf37-4817-92e8-98ccb07390e8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:52.896213 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-820cac1b-bf37-4817-92e8-98ccb07390e8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:52.901924 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-820cac1b-bf37-4817-92e8-98ccb07390e8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:52.902370 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-820cac1b-bf37-4817-92e8-98ccb07390e8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:52.903185 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-820cac1b-bf37-4817-92e8-98ccb07390e8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:52.903621 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-820cac1b-bf37-4817-92e8-98ccb07390e8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:53.133721 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-820cac1b-bf37-4817-92e8-98ccb07390e8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:53.141421 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-820cac1b-bf37-4817-92e8-98ccb07390e8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1316 microversion: 2.1 time: 0.249721 Feb 28 10:38:53.142689 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 453/871] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:52 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:54.160722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0493e40f-5d14-4b07-b360-521826451435 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:38:54.161325 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0493e40f-5d14-4b07-b360-521826451435 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:54.168106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0493e40f-5d14-4b07-b360-521826451435 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:54.168553 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0493e40f-5d14-4b07-b360-521826451435 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:54.169345 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0493e40f-5d14-4b07-b360-521826451435 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:54.169947 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0493e40f-5d14-4b07-b360-521826451435 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:54.646661 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-0493e40f-5d14-4b07-b360-521826451435 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:38:54.656051 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0493e40f-5d14-4b07-b360-521826451435 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1505 microversion: 2.1 time: 0.499002 Feb 28 10:38:54.669173 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 419/872] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:38:54 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:38:56.033556 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3cfd3521-0f17-4a19-a58d-584b42a3263c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "133fbb9c-1900-4e26-8580-641351685f5c"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:38:56.034771 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3cfd3521-0f17-4a19-a58d-584b42a3263c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:38:56.040985 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3cfd3521-0f17-4a19-a58d-584b42a3263c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:56.041433 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3cfd3521-0f17-4a19-a58d-584b42a3263c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:56.042210 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3cfd3521-0f17-4a19-a58d-584b42a3263c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:38:56.042719 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3cfd3521-0f17-4a19-a58d-584b42a3263c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:38:56.320659 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3cfd3521-0f17-4a19-a58d-584b42a3263c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "POST /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291630 Feb 28 10:38:56.321654 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 454/873] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:38:56 2022] POST /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:03.896334 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d803a8da-af20-4605-8803-2964f02fce0a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:03.896831 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d803a8da-af20-4605-8803-2964f02fce0a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:03.903139 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d803a8da-af20-4605-8803-2964f02fce0a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:03.903587 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d803a8da-af20-4605-8803-2964f02fce0a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:03.904367 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d803a8da-af20-4605-8803-2964f02fce0a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:03.904804 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d803a8da-af20-4605-8803-2964f02fce0a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:03.981027 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-d803a8da-af20-4605-8803-2964f02fce0a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lazy-loading 'services' on Instance uuid a94d0be3-19c9-4062-b71e-076350459b4c {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:39:04.050960 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d803a8da-af20-4605-8803-2964f02fce0a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "DELETE /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c/os-volume_attachments/133fbb9c-1900-4e26-8580-641351685f5c" status: 202 len: 0 microversion: 2.1 time: 0.158341 Feb 28 10:39:04.051855 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 420/874] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:39:03 2022] DELETE /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c/os-volume_attachments/133fbb9c-1900-4e26-8580-641351685f5c => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:39:04.061076 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0b321d68-4784-4a80-9098-0b423f220002 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:04.062275 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0b321d68-4784-4a80-9098-0b423f220002 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:04.068778 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0b321d68-4784-4a80-9098-0b423f220002 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:04.069238 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0b321d68-4784-4a80-9098-0b423f220002 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:04.070124 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0b321d68-4784-4a80-9098-0b423f220002 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:04.070527 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0b321d68-4784-4a80-9098-0b423f220002 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:04.102518 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0b321d68-4784-4a80-9098-0b423f220002 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046212 Feb 28 10:39:04.103364 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 455/875] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:39:04 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:05.119257 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a8d53d99-f8d4-4817-b5a5-08145715c9c8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:05.120208 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a8d53d99-f8d4-4817-b5a5-08145715c9c8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:05.126359 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a8d53d99-f8d4-4817-b5a5-08145715c9c8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:05.126850 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a8d53d99-f8d4-4817-b5a5-08145715c9c8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:05.127636 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a8d53d99-f8d4-4817-b5a5-08145715c9c8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:05.128075 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a8d53d99-f8d4-4817-b5a5-08145715c9c8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:05.155288 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a8d53d99-f8d4-4817-b5a5-08145715c9c8 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040951 Feb 28 10:39:05.156467 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 421/876] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 10:39:05 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 10:39:06.341566 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8538473e-56f1-4908-9b44-41267533b4d2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:06.342073 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8538473e-56f1-4908-9b44-41267533b4d2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:06.349310 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8538473e-56f1-4908-9b44-41267533b4d2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:06.349747 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8538473e-56f1-4908-9b44-41267533b4d2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:06.350524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8538473e-56f1-4908-9b44-41267533b4d2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:06.350978 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8538473e-56f1-4908-9b44-41267533b4d2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:06.377959 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8538473e-56f1-4908-9b44-41267533b4d2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:39:06.463020 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8538473e-56f1-4908-9b44-41267533b4d2 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "DELETE /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 204 len: 0 microversion: 2.1 time: 0.125051 Feb 28 10:39:06.463705 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 456/877] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:39:06 2022] DELETE /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:39:06.473315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c3c107e5-53be-4d13-bbc0-3afc3ac93814 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:06.474138 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c3c107e5-53be-4d13-bbc0-3afc3ac93814 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:06.482009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3c107e5-53be-4d13-bbc0-3afc3ac93814 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:06.482525 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3c107e5-53be-4d13-bbc0-3afc3ac93814 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:06.483510 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3c107e5-53be-4d13-bbc0-3afc3ac93814 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:06.484529 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c3c107e5-53be-4d13-bbc0-3afc3ac93814 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:06.633505 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c3c107e5-53be-4d13-bbc0-3afc3ac93814 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:06.641110 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c3c107e5-53be-4d13-bbc0-3afc3ac93814 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1511 microversion: 2.1 time: 0.173238 Feb 28 10:39:06.641664 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 422/878] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:06 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:07.658846 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-3592d750-027a-4554-a626-c8806eb6a3af tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:07.659453 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-3592d750-027a-4554-a626-c8806eb6a3af tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:07.665561 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3592d750-027a-4554-a626-c8806eb6a3af tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:07.666003 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3592d750-027a-4554-a626-c8806eb6a3af tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:07.666808 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3592d750-027a-4554-a626-c8806eb6a3af tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:07.667240 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-3592d750-027a-4554-a626-c8806eb6a3af tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:07.798391 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-3592d750-027a-4554-a626-c8806eb6a3af tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:07.805680 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-3592d750-027a-4554-a626-c8806eb6a3af tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1511 microversion: 2.1 time: 0.152220 Feb 28 10:39:07.806238 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 457/879] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:07 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:08.823171 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-d2e0c680-955c-428d-a0e7-a8587f64435f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:08.823747 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-d2e0c680-955c-428d-a0e7-a8587f64435f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:08.830470 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d2e0c680-955c-428d-a0e7-a8587f64435f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:08.830947 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d2e0c680-955c-428d-a0e7-a8587f64435f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:08.831807 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d2e0c680-955c-428d-a0e7-a8587f64435f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:08.832309 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-d2e0c680-955c-428d-a0e7-a8587f64435f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:08.904332 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-d2e0c680-955c-428d-a0e7-a8587f64435f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:08.912678 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-d2e0c680-955c-428d-a0e7-a8587f64435f tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 200 len: 1469 microversion: 2.1 time: 0.093708 Feb 28 10:39:08.913324 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 423/880] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:08 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 1469 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:39:08.961532 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-7fd9de21-596a-4ff9-8431-cc75c66dc2f0 req-28749eb8-3345-4cec-bf5c-e1501305c1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94d0be3-19c9-4062-b71e-076350459b4c", "name": "network-vif-deleted", "tag": "73d4538a-af6f-4c0f-a3f8-5937a632c3c4"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:08.970623 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-7fd9de21-596a-4ff9-8431-cc75c66dc2f0 req-28749eb8-3345-4cec-bf5c-e1501305c1b1 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:08.971101 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-7fd9de21-596a-4ff9-8431-cc75c66dc2f0 req-28749eb8-3345-4cec-bf5c-e1501305c1b1 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:08.982308 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-7fd9de21-596a-4ff9-8431-cc75c66dc2f0 req-28749eb8-3345-4cec-bf5c-e1501305c1b1 service nova] Creating event network-vif-deleted:73d4538a-af6f-4c0f-a3f8-5937a632c3c4 for instance a94d0be3-19c9-4062-b71e-076350459b4c on hv-cinder-maste Feb 28 10:39:08.988311 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-7fd9de21-596a-4ff9-8431-cc75c66dc2f0 req-28749eb8-3345-4cec-bf5c-e1501305c1b1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030217 Feb 28 10:39:08.988903 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 458/881] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:09.930334 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4c4ead27-aa87-46d3-90fa-2d8e4bb817ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:09.931011 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4c4ead27-aa87-46d3-90fa-2d8e4bb817ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: a94d0be3-19c9-4062-b71e-076350459b4c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:09.937473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4c4ead27-aa87-46d3-90fa-2d8e4bb817ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:09.938027 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4c4ead27-aa87-46d3-90fa-2d8e4bb817ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:09.938941 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4c4ead27-aa87-46d3-90fa-2d8e4bb817ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:09.939452 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4c4ead27-aa87-46d3-90fa-2d8e4bb817ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:09.953011 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-4c4ead27-aa87-46d3-90fa-2d8e4bb817ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] HTTP exception thrown: Instance a94d0be3-19c9-4062-b71e-076350459b4c could not be found. Feb 28 10:39:09.953827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4c4ead27-aa87-46d3-90fa-2d8e4bb817ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Returning 404 to user: Instance a94d0be3-19c9-4062-b71e-076350459b4c could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:39:09.954838 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4c4ead27-aa87-46d3-90fa-2d8e4bb817ff tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c" status: 404 len: 111 microversion: 2.1 time: 0.028445 Feb 28 10:39:09.955460 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 424/882] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:09 2022] GET /compute/v2.1/servers/a94d0be3-19c9-4062-b71e-076350459b4c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:39:11.090313 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c18ea6a6-6897-4ca6-9a9f-c61e52730f5e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:11.091051 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c18ea6a6-6897-4ca6-9a9f-c61e52730f5e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:11.098664 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c18ea6a6-6897-4ca6-9a9f-c61e52730f5e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:11.099188 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c18ea6a6-6897-4ca6-9a9f-c61e52730f5e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:11.100130 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c18ea6a6-6897-4ca6-9a9f-c61e52730f5e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:11.100634 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c18ea6a6-6897-4ca6-9a9f-c61e52730f5e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:11.125317 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c18ea6a6-6897-4ca6-9a9f-c61e52730f5e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:39:11.206928 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c18ea6a6-6897-4ca6-9a9f-c61e52730f5e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 204 len: 0 microversion: 2.1 time: 0.120781 Feb 28 10:39:11.207519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 459/883] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:39:11 2022] DELETE /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:39:11.215586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4ae37e9b-786e-418f-9297-a83fa6003ee1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:11.216192 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4ae37e9b-786e-418f-9297-a83fa6003ee1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:11.223143 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4ae37e9b-786e-418f-9297-a83fa6003ee1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:11.223617 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4ae37e9b-786e-418f-9297-a83fa6003ee1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:11.224391 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4ae37e9b-786e-418f-9297-a83fa6003ee1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:11.224819 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4ae37e9b-786e-418f-9297-a83fa6003ee1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:11.364188 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4ae37e9b-786e-418f-9297-a83fa6003ee1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:11.371960 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4ae37e9b-786e-418f-9297-a83fa6003ee1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1513 microversion: 2.1 time: 0.160187 Feb 28 10:39:11.372693 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 425/884] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:11 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:39:12.389721 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1670f418-62ea-42f1-b136-b5b1eb03894a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:12.391048 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1670f418-62ea-42f1-b136-b5b1eb03894a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:12.397424 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1670f418-62ea-42f1-b136-b5b1eb03894a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:12.397867 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1670f418-62ea-42f1-b136-b5b1eb03894a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:12.398669 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1670f418-62ea-42f1-b136-b5b1eb03894a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:12.399120 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1670f418-62ea-42f1-b136-b5b1eb03894a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:12.539990 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1670f418-62ea-42f1-b136-b5b1eb03894a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:12.548768 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1670f418-62ea-42f1-b136-b5b1eb03894a tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1513 microversion: 2.1 time: 0.163201 Feb 28 10:39:12.549344 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 460/885] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:12 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:13.570362 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-602d9937-50ca-46e1-9563-9f94ddfe91d1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:13.571297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-602d9937-50ca-46e1-9563-9f94ddfe91d1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:13.577815 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-602d9937-50ca-46e1-9563-9f94ddfe91d1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:13.578405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-602d9937-50ca-46e1-9563-9f94ddfe91d1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:13.579204 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-602d9937-50ca-46e1-9563-9f94ddfe91d1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:13.579701 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-602d9937-50ca-46e1-9563-9f94ddfe91d1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:13.605522 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-f1c10502-2776-4c79-bfd6-289d9bbd8298 req-47208fe3-14e0-4576-9bcc-ceb3028883ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c77b1c-69c1-4483-aa2d-3a097096ff04", "name": "network-vif-deleted", "tag": "fc7add66-658c-4fc8-b830-725fe0ddd217"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:13.622233 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-f1c10502-2776-4c79-bfd6-289d9bbd8298 req-47208fe3-14e0-4576-9bcc-ceb3028883ef service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:13.622789 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-f1c10502-2776-4c79-bfd6-289d9bbd8298 req-47208fe3-14e0-4576-9bcc-ceb3028883ef service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:13.634703 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-f1c10502-2776-4c79-bfd6-289d9bbd8298 req-47208fe3-14e0-4576-9bcc-ceb3028883ef service nova] Creating event network-vif-deleted:fc7add66-658c-4fc8-b830-725fe0ddd217 for instance f4c77b1c-69c1-4483-aa2d-3a097096ff04 on hv-cinder-maste Feb 28 10:39:13.640440 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-f1c10502-2776-4c79-bfd6-289d9bbd8298 req-47208fe3-14e0-4576-9bcc-ceb3028883ef service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037964 Feb 28 10:39:13.641448 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 461/886] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:39:13.669255 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-602d9937-50ca-46e1-9563-9f94ddfe91d1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:13.678805 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-602d9937-50ca-46e1-9563-9f94ddfe91d1 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 200 len: 1471 microversion: 2.1 time: 0.116935 Feb 28 10:39:13.679710 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 426/887] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:13 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 1471 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:14.697196 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b192defd-6827-4da1-9287-fc91ad8b9291 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:14.698066 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b192defd-6827-4da1-9287-fc91ad8b9291 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: f4c77b1c-69c1-4483-aa2d-3a097096ff04] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:14.704569 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b192defd-6827-4da1-9287-fc91ad8b9291 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:14.705015 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b192defd-6827-4da1-9287-fc91ad8b9291 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:14.705815 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b192defd-6827-4da1-9287-fc91ad8b9291 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:14.706254 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b192defd-6827-4da1-9287-fc91ad8b9291 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:14.720374 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-b192defd-6827-4da1-9287-fc91ad8b9291 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] HTTP exception thrown: Instance f4c77b1c-69c1-4483-aa2d-3a097096ff04 could not be found. Feb 28 10:39:14.720963 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b192defd-6827-4da1-9287-fc91ad8b9291 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Returning 404 to user: Instance f4c77b1c-69c1-4483-aa2d-3a097096ff04 could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:39:14.721783 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b192defd-6827-4da1-9287-fc91ad8b9291 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04" status: 404 len: 111 microversion: 2.1 time: 0.029352 Feb 28 10:39:14.722558 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 462/888] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:14 2022] GET /compute/v2.1/servers/f4c77b1c-69c1-4483-aa2d-3a097096ff04 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:39:14.730803 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a424f8ef-e23a-4da6-8491-cbe3a7d6c93b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:14.731917 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a424f8ef-e23a-4da6-8491-cbe3a7d6c93b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:14.738996 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a424f8ef-e23a-4da6-8491-cbe3a7d6c93b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:14.739430 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a424f8ef-e23a-4da6-8491-cbe3a7d6c93b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:14.740228 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a424f8ef-e23a-4da6-8491-cbe3a7d6c93b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:14.740680 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a424f8ef-e23a-4da6-8491-cbe3a7d6c93b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:14.766567 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a424f8ef-e23a-4da6-8491-cbe3a7d6c93b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Going to try to terminate instance {{(pid=123151) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:39:14.841456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a424f8ef-e23a-4da6-8491-cbe3a7d6c93b tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 204 len: 0 microversion: 2.1 time: 0.114315 Feb 28 10:39:14.842096 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 427/889] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:39:14 2022] DELETE /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:39:14.852061 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-16a51706-dab8-497a-ad87-32a4aa840e56 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:14.852751 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-16a51706-dab8-497a-ad87-32a4aa840e56 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:14.861475 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-16a51706-dab8-497a-ad87-32a4aa840e56 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:14.862240 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-16a51706-dab8-497a-ad87-32a4aa840e56 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:14.863310 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-16a51706-dab8-497a-ad87-32a4aa840e56 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:14.863754 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-16a51706-dab8-497a-ad87-32a4aa840e56 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:14.999203 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-16a51706-dab8-497a-ad87-32a4aa840e56 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:15.007002 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-16a51706-dab8-497a-ad87-32a4aa840e56 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1512 microversion: 2.1 time: 0.159245 Feb 28 10:39:15.007559 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 463/890] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:14 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:16.024783 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a9873db5-7143-4e6b-96f4-4b43e17efa9e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:16.025475 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a9873db5-7143-4e6b-96f4-4b43e17efa9e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:16.032793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a9873db5-7143-4e6b-96f4-4b43e17efa9e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:16.033236 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a9873db5-7143-4e6b-96f4-4b43e17efa9e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:16.034012 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a9873db5-7143-4e6b-96f4-4b43e17efa9e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:16.034440 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a9873db5-7143-4e6b-96f4-4b43e17efa9e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:16.173321 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a9873db5-7143-4e6b-96f4-4b43e17efa9e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:16.181040 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a9873db5-7143-4e6b-96f4-4b43e17efa9e tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1512 microversion: 2.1 time: 0.160512 Feb 28 10:39:16.181595 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 428/891] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:16 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:16.985723 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-6946e1a1-3316-46ee-91b5-17b36c8ea469 req-e2d7ccea-fb03-4823-bfc7-1af47b958440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69d4311-bc1d-48b3-b94e-2584548842d8", "name": "network-vif-deleted", "tag": "a01d0d57-ecde-4dc6-9390-13e26151d5a6"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:16.994267 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-6946e1a1-3316-46ee-91b5-17b36c8ea469 req-e2d7ccea-fb03-4823-bfc7-1af47b958440 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:16.994734 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-6946e1a1-3316-46ee-91b5-17b36c8ea469 req-e2d7ccea-fb03-4823-bfc7-1af47b958440 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:17.007652 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-6946e1a1-3316-46ee-91b5-17b36c8ea469 req-e2d7ccea-fb03-4823-bfc7-1af47b958440 service nova] Creating event network-vif-deleted:a01d0d57-ecde-4dc6-9390-13e26151d5a6 for instance b69d4311-bc1d-48b3-b94e-2584548842d8 on hv-cinder-maste Feb 28 10:39:17.012864 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-6946e1a1-3316-46ee-91b5-17b36c8ea469 req-e2d7ccea-fb03-4823-bfc7-1af47b958440 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031408 Feb 28 10:39:17.013448 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 464/892] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:17.197527 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:17.198142 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:17.204646 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:17.205079 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:17.205868 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:17.206302 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:17.238455 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:17.238954 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:17.239413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lazy-loading 'fault' on Instance uuid b69d4311-bc1d-48b3-b94e-2584548842d8 {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:39:17.279756 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:17.287834 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3572e18d-d728-461a-a761-c8d5b0d2d749 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 200 len: 1307 microversion: 2.1 time: 0.094317 Feb 28 10:39:17.288391 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 429/893] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:17 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:18.307276 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-18ec8cd7-b95b-45d1-97f6-88aee8a3f2ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:18.308112 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-18ec8cd7-b95b-45d1-97f6-88aee8a3f2ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: b69d4311-bc1d-48b3-b94e-2584548842d8] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:18.315741 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-18ec8cd7-b95b-45d1-97f6-88aee8a3f2ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:18.316189 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-18ec8cd7-b95b-45d1-97f6-88aee8a3f2ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:18.316985 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-18ec8cd7-b95b-45d1-97f6-88aee8a3f2ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:18.317447 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-18ec8cd7-b95b-45d1-97f6-88aee8a3f2ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:18.335720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-18ec8cd7-b95b-45d1-97f6-88aee8a3f2ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] HTTP exception thrown: Instance b69d4311-bc1d-48b3-b94e-2584548842d8 could not be found. Feb 28 10:39:18.336313 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-18ec8cd7-b95b-45d1-97f6-88aee8a3f2ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Returning 404 to user: Instance b69d4311-bc1d-48b3-b94e-2584548842d8 could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:39:18.337136 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-18ec8cd7-b95b-45d1-97f6-88aee8a3f2ae tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8" status: 404 len: 111 microversion: 2.1 time: 0.035416 Feb 28 10:39:18.337687 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 465/894] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:18 2022] GET /compute/v2.1/servers/b69d4311-bc1d-48b3-b94e-2584548842d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:39:19.481482 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-dc6c1d74-03d5-4d15-b3dd-791b07db4f59 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:19.482009 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-dc6c1d74-03d5-4d15-b3dd-791b07db4f59 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:19.488662 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dc6c1d74-03d5-4d15-b3dd-791b07db4f59 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:19.489105 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dc6c1d74-03d5-4d15-b3dd-791b07db4f59 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:19.489995 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dc6c1d74-03d5-4d15-b3dd-791b07db4f59 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:19.490511 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-dc6c1d74-03d5-4d15-b3dd-791b07db4f59 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:19.517231 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-dc6c1d74-03d5-4d15-b3dd-791b07db4f59 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Going to try to terminate instance {{(pid=123151) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:39:19.597861 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-dc6c1d74-03d5-4d15-b3dd-791b07db4f59 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 204 len: 0 microversion: 2.1 time: 0.118917 Feb 28 10:39:19.598455 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 430/895] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:39:19 2022] DELETE /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:39:19.606295 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5a01ce90-c07e-405f-b814-bbcd2b67d27c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:19.606931 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5a01ce90-c07e-405f-b814-bbcd2b67d27c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:19.613889 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5a01ce90-c07e-405f-b814-bbcd2b67d27c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:19.614416 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5a01ce90-c07e-405f-b814-bbcd2b67d27c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:19.615312 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5a01ce90-c07e-405f-b814-bbcd2b67d27c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:19.615748 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5a01ce90-c07e-405f-b814-bbcd2b67d27c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:19.762540 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5a01ce90-c07e-405f-b814-bbcd2b67d27c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:19.770254 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5a01ce90-c07e-405f-b814-bbcd2b67d27c tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1512 microversion: 2.1 time: 0.167813 Feb 28 10:39:19.770835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 466/896] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:19 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:20.788899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a9bd1113-4cb6-4c45-96e0-96fe22cbf1c6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:20.789616 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a9bd1113-4cb6-4c45-96e0-96fe22cbf1c6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:20.796061 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a9bd1113-4cb6-4c45-96e0-96fe22cbf1c6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:20.797047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a9bd1113-4cb6-4c45-96e0-96fe22cbf1c6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:20.797833 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a9bd1113-4cb6-4c45-96e0-96fe22cbf1c6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:20.798266 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a9bd1113-4cb6-4c45-96e0-96fe22cbf1c6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:20.947351 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a9bd1113-4cb6-4c45-96e0-96fe22cbf1c6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:20.954673 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a9bd1113-4cb6-4c45-96e0-96fe22cbf1c6 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1512 microversion: 2.1 time: 0.170044 Feb 28 10:39:20.955236 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 431/897] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:20 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:39:21.870530 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-844fa5f2-87da-421e-94a0-e5ad3c8433ef req-c17af58e-bcb0-4dd1-9106-df944a86a0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9afa739-da2b-478b-af9a-7ea5ad86650d", "name": "network-vif-deleted", "tag": "2df07693-98c8-4c85-a461-d68a9578eb1a"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:21.881364 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-844fa5f2-87da-421e-94a0-e5ad3c8433ef req-c17af58e-bcb0-4dd1-9106-df944a86a0fd service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:21.881787 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-844fa5f2-87da-421e-94a0-e5ad3c8433ef req-c17af58e-bcb0-4dd1-9106-df944a86a0fd service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:21.894128 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-844fa5f2-87da-421e-94a0-e5ad3c8433ef req-c17af58e-bcb0-4dd1-9106-df944a86a0fd service nova] Creating event network-vif-deleted:2df07693-98c8-4c85-a461-d68a9578eb1a for instance c9afa739-da2b-478b-af9a-7ea5ad86650d on hv-cinder-maste Feb 28 10:39:21.899043 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-844fa5f2-87da-421e-94a0-e5ad3c8433ef req-c17af58e-bcb0-4dd1-9106-df944a86a0fd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032117 Feb 28 10:39:21.899659 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 467/898] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:21.972000 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:21.972949 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:21.979989 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:21.980443 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:21.981233 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:21.981673 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:22.013591 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:22.014036 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:22.014489 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lazy-loading 'fault' on Instance uuid c9afa739-da2b-478b-af9a-7ea5ad86650d {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:39:22.056767 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cdcba6d332b492196494db46ced8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c79b1decd974ef2bb73bf55edc02f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:22.064705 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-1a8a7ac5-4b91-4b97-9015-873fafcea983 tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 200 len: 1307 microversion: 2.1 time: 0.096811 Feb 28 10:39:22.065273 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 432/899] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:21 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:23.083164 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-244b4fae-110e-49e6-9f42-f3f967763f8d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:23.083837 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-244b4fae-110e-49e6-9f42-f3f967763f8d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] [instance: c9afa739-da2b-478b-af9a-7ea5ad86650d] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:23.089958 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-244b4fae-110e-49e6-9f42-f3f967763f8d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:23.090405 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-244b4fae-110e-49e6-9f42-f3f967763f8d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:23.091213 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-244b4fae-110e-49e6-9f42-f3f967763f8d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:23.091670 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-244b4fae-110e-49e6-9f42-f3f967763f8d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:23.111385 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-244b4fae-110e-49e6-9f42-f3f967763f8d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] HTTP exception thrown: Instance c9afa739-da2b-478b-af9a-7ea5ad86650d could not be found. Feb 28 10:39:23.111976 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-244b4fae-110e-49e6-9f42-f3f967763f8d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] Returning 404 to user: Instance c9afa739-da2b-478b-af9a-7ea5ad86650d could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:39:23.112797 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-244b4fae-110e-49e6-9f42-f3f967763f8d tempest-AttachVolumeNegativeTest-1589508515 tempest-AttachVolumeNegativeTest-1589508515-project] 10.222.0.21 "GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d" status: 404 len: 111 microversion: 2.1 time: 0.034575 Feb 28 10:39:23.113350 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 468/900] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:23 2022] GET /compute/v2.1/servers/c9afa739-da2b-478b-af9a-7ea5ad86650d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 10:39:34.263957 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9b640d6f-ec9a-463b-9fc5-e759545d22ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:34.266734 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9b640d6f-ec9a-463b-9fc5-e759545d22ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:34.273457 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b640d6f-ec9a-463b-9fc5-e759545d22ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:34.273906 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b640d6f-ec9a-463b-9fc5-e759545d22ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:34.274710 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b640d6f-ec9a-463b-9fc5-e759545d22ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:34.275147 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9b640d6f-ec9a-463b-9fc5-e759545d22ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:34.299156 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9b640d6f-ec9a-463b-9fc5-e759545d22ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Going to try to terminate instance {{(pid=123151) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:39:34.375628 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9b640d6f-ec9a-463b-9fc5-e759545d22ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 204 len: 0 microversion: 2.1 time: 0.115270 Feb 28 10:39:34.376203 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 433/901] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:39:34 2022] DELETE /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 10:39:34.385304 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-052157d2-59dd-4c63-a59c-03b979e504aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:34.386008 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-052157d2-59dd-4c63-a59c-03b979e504aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:34.393382 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-052157d2-59dd-4c63-a59c-03b979e504aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:34.393830 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-052157d2-59dd-4c63-a59c-03b979e504aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:34.394630 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-052157d2-59dd-4c63-a59c-03b979e504aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:34.395168 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-052157d2-59dd-4c63-a59c-03b979e504aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:34.537516 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-052157d2-59dd-4c63-a59c-03b979e504aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:34.544877 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-052157d2-59dd-4c63-a59c-03b979e504aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.164157 Feb 28 10:39:34.545468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 469/902] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:34 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:35.563570 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-57bace62-5435-490f-b203-117091173c06 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:35.564265 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-57bace62-5435-490f-b203-117091173c06 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:35.570350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-57bace62-5435-490f-b203-117091173c06 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:35.570827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-57bace62-5435-490f-b203-117091173c06 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:35.571716 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-57bace62-5435-490f-b203-117091173c06 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:35.572137 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-57bace62-5435-490f-b203-117091173c06 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:35.720664 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-57bace62-5435-490f-b203-117091173c06 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:35.728377 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-57bace62-5435-490f-b203-117091173c06 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.169789 Feb 28 10:39:35.728939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 434/903] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:35 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:36.745399 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c3070602-e042-4903-9d59-f2cb3795f8aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:36.746037 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c3070602-e042-4903-9d59-f2cb3795f8aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:36.753869 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c3070602-e042-4903-9d59-f2cb3795f8aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:36.754347 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c3070602-e042-4903-9d59-f2cb3795f8aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:36.755167 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c3070602-e042-4903-9d59-f2cb3795f8aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:36.755606 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c3070602-e042-4903-9d59-f2cb3795f8aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:36.893851 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c3070602-e042-4903-9d59-f2cb3795f8aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:36.901264 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c3070602-e042-4903-9d59-f2cb3795f8aa tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.159722 Feb 28 10:39:36.901830 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 470/904] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:36 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:37.920436 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3b56c8f9-351f-47fe-a59c-8d9cccfe81dd tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:37.921892 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3b56c8f9-351f-47fe-a59c-8d9cccfe81dd tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:37.931143 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b56c8f9-351f-47fe-a59c-8d9cccfe81dd tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:37.931733 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b56c8f9-351f-47fe-a59c-8d9cccfe81dd tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:37.932721 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b56c8f9-351f-47fe-a59c-8d9cccfe81dd tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:37.933186 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3b56c8f9-351f-47fe-a59c-8d9cccfe81dd tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:38.074431 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3b56c8f9-351f-47fe-a59c-8d9cccfe81dd tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:38.082055 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3b56c8f9-351f-47fe-a59c-8d9cccfe81dd tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.166678 Feb 28 10:39:38.082690 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 435/905] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:37 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:39.099578 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1450a08a-1044-4383-a7f1-531a72046aee tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:39.100184 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1450a08a-1044-4383-a7f1-531a72046aee tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:39.106366 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1450a08a-1044-4383-a7f1-531a72046aee tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:39.106847 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1450a08a-1044-4383-a7f1-531a72046aee tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:39.107623 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1450a08a-1044-4383-a7f1-531a72046aee tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:39.108048 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1450a08a-1044-4383-a7f1-531a72046aee tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:39.256375 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1450a08a-1044-4383-a7f1-531a72046aee tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:39.264282 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1450a08a-1044-4383-a7f1-531a72046aee tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.168753 Feb 28 10:39:39.265424 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 471/906] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:39 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:39.727957 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-ce0a4e86-47bc-472f-af88-a70e79067e4f req-4e3fd592-f9f8-4108-afa1-09e809cbd350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1357a1-2e5f-4972-91cc-f16f95ebeb23", "name": "network-vif-unplugged", "status": "completed", "tag": "529b48cb-8201-4cd7-9a2e-93e7994b3a10"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:39.738263 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-ce0a4e86-47bc-472f-af88-a70e79067e4f req-4e3fd592-f9f8-4108-afa1-09e809cbd350 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:39.739116 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-ce0a4e86-47bc-472f-af88-a70e79067e4f req-4e3fd592-f9f8-4108-afa1-09e809cbd350 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:39.758402 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-ce0a4e86-47bc-472f-af88-a70e79067e4f req-4e3fd592-f9f8-4108-afa1-09e809cbd350 service nova] Creating event network-vif-unplugged:529b48cb-8201-4cd7-9a2e-93e7994b3a10 for instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 on hv-cinder-maste Feb 28 10:39:39.763255 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-ce0a4e86-47bc-472f-af88-a70e79067e4f req-4e3fd592-f9f8-4108-afa1-09e809cbd350 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039049 Feb 28 10:39:39.763845 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 436/907] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:40.281862 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-20af4fd8-b912-4e0e-b630-7d043edbb528 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:40.282476 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-20af4fd8-b912-4e0e-b630-7d043edbb528 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:40.289109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-20af4fd8-b912-4e0e-b630-7d043edbb528 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:40.289565 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-20af4fd8-b912-4e0e-b630-7d043edbb528 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:40.290350 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-20af4fd8-b912-4e0e-b630-7d043edbb528 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:40.290818 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-20af4fd8-b912-4e0e-b630-7d043edbb528 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:40.427109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-20af4fd8-b912-4e0e-b630-7d043edbb528 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:40.434887 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-20af4fd8-b912-4e0e-b630-7d043edbb528 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.157475 Feb 28 10:39:40.435551 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 472/908] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:40 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:41.453586 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2d6c9ebe-57dd-4d4d-ba3b-d236650a547f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:41.454434 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2d6c9ebe-57dd-4d4d-ba3b-d236650a547f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:41.460384 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d6c9ebe-57dd-4d4d-ba3b-d236650a547f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:41.460833 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d6c9ebe-57dd-4d4d-ba3b-d236650a547f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:41.461622 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d6c9ebe-57dd-4d4d-ba3b-d236650a547f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:41.462098 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d6c9ebe-57dd-4d4d-ba3b-d236650a547f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:41.601047 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-2d6c9ebe-57dd-4d4d-ba3b-d236650a547f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:41.609265 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2d6c9ebe-57dd-4d4d-ba3b-d236650a547f tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.159887 Feb 28 10:39:41.609847 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 437/909] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:41 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:42.626848 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c5f93c97-450c-4e98-8407-d62cbefe015e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:42.627568 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-c5f93c97-450c-4e98-8407-d62cbefe015e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:42.634727 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c5f93c97-450c-4e98-8407-d62cbefe015e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:42.635245 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c5f93c97-450c-4e98-8407-d62cbefe015e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:42.636790 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c5f93c97-450c-4e98-8407-d62cbefe015e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:42.637363 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-c5f93c97-450c-4e98-8407-d62cbefe015e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:42.908147 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-c5f93c97-450c-4e98-8407-d62cbefe015e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:42.918832 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c5f93c97-450c-4e98-8407-d62cbefe015e tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.296718 Feb 28 10:39:42.920110 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 473/910] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:42 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:43.938364 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-73e6cb5c-8953-443f-baee-c223b713be07 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:43.939015 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-73e6cb5c-8953-443f-baee-c223b713be07 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:43.945286 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-73e6cb5c-8953-443f-baee-c223b713be07 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:43.945732 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-73e6cb5c-8953-443f-baee-c223b713be07 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:43.946515 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-73e6cb5c-8953-443f-baee-c223b713be07 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:43.946964 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-73e6cb5c-8953-443f-baee-c223b713be07 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:44.039260 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0c46036b-200c-4a85-83e5-fb2545f662a0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:44.039909 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0c46036b-200c-4a85-83e5-fb2545f662a0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:44.050842 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0c46036b-200c-4a85-83e5-fb2545f662a0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:44.051437 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0c46036b-200c-4a85-83e5-fb2545f662a0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:44.052344 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0c46036b-200c-4a85-83e5-fb2545f662a0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:44.052886 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0c46036b-200c-4a85-83e5-fb2545f662a0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:44.085438 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0c46036b-200c-4a85-83e5-fb2545f662a0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:39:44.131473 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-73e6cb5c-8953-443f-baee-c223b713be07 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:44.139695 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-73e6cb5c-8953-443f-baee-c223b713be07 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.206013 Feb 28 10:39:44.140950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 438/911] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:43 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:44.146039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-b7187fc8-ee8d-430f-9e9b-182a50677856 req-35b8e783-078e-45c6-a291-e0debb4c6659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6a8a33-e76e-450b-a94a-a0852fc6472c", "tag": "c294705d-35da-4f5d-8e43-0a930f3b63a3"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:44.156274 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-b7187fc8-ee8d-430f-9e9b-182a50677856 req-35b8e783-078e-45c6-a291-e0debb4c6659 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:44.157264 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-b7187fc8-ee8d-430f-9e9b-182a50677856 req-35b8e783-078e-45c6-a291-e0debb4c6659 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:44.174786 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-b7187fc8-ee8d-430f-9e9b-182a50677856 req-35b8e783-078e-45c6-a291-e0debb4c6659 service nova] Creating event network-changed:c294705d-35da-4f5d-8e43-0a930f3b63a3 for instance 6f6a8a33-e76e-450b-a94a-a0852fc6472c on hv-cinder-maste Feb 28 10:39:44.192314 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-b7187fc8-ee8d-430f-9e9b-182a50677856 req-35b8e783-078e-45c6-a291-e0debb4c6659 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049049 Feb 28 10:39:44.193257 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 439/912] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:44.199074 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0c46036b-200c-4a85-83e5-fb2545f662a0 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 204 len: 0 microversion: 2.1 time: 0.164153 Feb 28 10:39:44.199662 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 474/913] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:39:44 2022] DELETE /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:39:44.209314 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6ea0dd65-70bc-4c74-9d24-ceb3dcb52218 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:44.210249 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6ea0dd65-70bc-4c74-9d24-ceb3dcb52218 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:44.217208 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6ea0dd65-70bc-4c74-9d24-ceb3dcb52218 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:44.218005 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6ea0dd65-70bc-4c74-9d24-ceb3dcb52218 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:44.219901 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6ea0dd65-70bc-4c74-9d24-ceb3dcb52218 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:44.220562 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6ea0dd65-70bc-4c74-9d24-ceb3dcb52218 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:44.456168 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6ea0dd65-70bc-4c74-9d24-ceb3dcb52218 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:44.463739 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6ea0dd65-70bc-4c74-9d24-ceb3dcb52218 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1570 microversion: 2.1 time: 0.258750 Feb 28 10:39:44.464543 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 440/914] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:44 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1570 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:45.159011 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4655d90c-163f-4cb2-a997-1b0d7eff0fdb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:45.159730 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4655d90c-163f-4cb2-a997-1b0d7eff0fdb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:45.166371 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4655d90c-163f-4cb2-a997-1b0d7eff0fdb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:45.166864 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4655d90c-163f-4cb2-a997-1b0d7eff0fdb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:45.167856 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4655d90c-163f-4cb2-a997-1b0d7eff0fdb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:45.168468 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4655d90c-163f-4cb2-a997-1b0d7eff0fdb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:45.385579 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4655d90c-163f-4cb2-a997-1b0d7eff0fdb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:45.393099 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4655d90c-163f-4cb2-a997-1b0d7eff0fdb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.239527 Feb 28 10:39:45.394272 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 475/915] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:45 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:45.483242 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3f10e87f-3ee1-43e9-9e96-8f200aa1349e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:45.484179 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3f10e87f-3ee1-43e9-9e96-8f200aa1349e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:45.490553 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f10e87f-3ee1-43e9-9e96-8f200aa1349e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:45.491042 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f10e87f-3ee1-43e9-9e96-8f200aa1349e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:45.491838 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f10e87f-3ee1-43e9-9e96-8f200aa1349e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:45.492280 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3f10e87f-3ee1-43e9-9e96-8f200aa1349e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:45.632657 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3f10e87f-3ee1-43e9-9e96-8f200aa1349e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:45.640826 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3f10e87f-3ee1-43e9-9e96-8f200aa1349e tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1451 microversion: 2.1 time: 0.161370 Feb 28 10:39:45.641401 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 441/916] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:45 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:46.410894 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5b4be0a2-6a82-42c1-ac8c-1b52b6cf12e8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:46.411486 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5b4be0a2-6a82-42c1-ac8c-1b52b6cf12e8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:46.418196 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5b4be0a2-6a82-42c1-ac8c-1b52b6cf12e8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:46.418997 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5b4be0a2-6a82-42c1-ac8c-1b52b6cf12e8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:46.419803 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5b4be0a2-6a82-42c1-ac8c-1b52b6cf12e8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:46.420229 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5b4be0a2-6a82-42c1-ac8c-1b52b6cf12e8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:46.658794 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a087514f-803a-4dd1-90e7-75c9acc11bed tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:46.659549 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a087514f-803a-4dd1-90e7-75c9acc11bed tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:46.666048 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a087514f-803a-4dd1-90e7-75c9acc11bed tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:46.666515 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a087514f-803a-4dd1-90e7-75c9acc11bed tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:46.667361 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a087514f-803a-4dd1-90e7-75c9acc11bed tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:46.667985 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a087514f-803a-4dd1-90e7-75c9acc11bed tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:46.690471 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5b4be0a2-6a82-42c1-ac8c-1b52b6cf12e8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:46.699556 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5b4be0a2-6a82-42c1-ac8c-1b52b6cf12e8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1578 microversion: 2.1 time: 0.292269 Feb 28 10:39:46.711093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 476/917] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:46 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1578 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:46.920456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a087514f-803a-4dd1-90e7-75c9acc11bed tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:46.942877 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a087514f-803a-4dd1-90e7-75c9acc11bed tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1451 microversion: 2.1 time: 0.280188 Feb 28 10:39:46.956531 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 442/918] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:46 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1451 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:39:47.341771 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-21ef7b07-8264-43f6-9f6c-a2a011925601 req-5dcc1398-933d-4d0b-b22e-34958b64373c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6a8a33-e76e-450b-a94a-a0852fc6472c", "name": "network-vif-deleted", "tag": "c294705d-35da-4f5d-8e43-0a930f3b63a3"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:47.358186 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-21ef7b07-8264-43f6-9f6c-a2a011925601 req-5dcc1398-933d-4d0b-b22e-34958b64373c service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:47.359764 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-21ef7b07-8264-43f6-9f6c-a2a011925601 req-5dcc1398-933d-4d0b-b22e-34958b64373c service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:47.367045 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-2a63aacf-34aa-4229-a00f-6b5acb471b59 req-79654d41-223e-4a98-a960-ced6edfba511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1357a1-2e5f-4972-91cc-f16f95ebeb23", "name": "network-vif-deleted", "tag": "529b48cb-8201-4cd7-9a2e-93e7994b3a10"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:47.377883 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-21ef7b07-8264-43f6-9f6c-a2a011925601 req-5dcc1398-933d-4d0b-b22e-34958b64373c service nova] Creating event network-vif-deleted:c294705d-35da-4f5d-8e43-0a930f3b63a3 for instance 6f6a8a33-e76e-450b-a94a-a0852fc6472c on hv-cinder-maste Feb 28 10:39:47.385730 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-21ef7b07-8264-43f6-9f6c-a2a011925601 req-5dcc1398-933d-4d0b-b22e-34958b64373c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055077 Feb 28 10:39:47.387060 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 477/919] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:47.387463 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-2a63aacf-34aa-4229-a00f-6b5acb471b59 req-79654d41-223e-4a98-a960-ced6edfba511 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:47.387920 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-2a63aacf-34aa-4229-a00f-6b5acb471b59 req-79654d41-223e-4a98-a960-ced6edfba511 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:47.415935 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-2a63aacf-34aa-4229-a00f-6b5acb471b59 req-79654d41-223e-4a98-a960-ced6edfba511 service nova] Creating event network-vif-deleted:529b48cb-8201-4cd7-9a2e-93e7994b3a10 for instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 on hv-cinder-maste Feb 28 10:39:47.422898 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-2a63aacf-34aa-4229-a00f-6b5acb471b59 req-79654d41-223e-4a98-a960-ced6edfba511 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058210 Feb 28 10:39:47.427644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 443/920] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:39:47.720501 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1dc10bc0-94b9-4176-9b16-adee387e5e63 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:47.721214 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1dc10bc0-94b9-4176-9b16-adee387e5e63 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:47.729858 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1dc10bc0-94b9-4176-9b16-adee387e5e63 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:47.730724 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1dc10bc0-94b9-4176-9b16-adee387e5e63 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:47.732643 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1dc10bc0-94b9-4176-9b16-adee387e5e63 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:47.733264 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1dc10bc0-94b9-4176-9b16-adee387e5e63 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:47.821214 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1dc10bc0-94b9-4176-9b16-adee387e5e63 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:47.829183 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1dc10bc0-94b9-4176-9b16-adee387e5e63 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 200 len: 1226 microversion: 2.1 time: 0.113460 Feb 28 10:39:47.829952 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 478/921] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:47 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:47.967421 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:47.968694 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:47.988404 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:47.989019 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:47.990802 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:47.991278 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:48.043742 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:48.044320 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:48.044707 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lazy-loading 'fault' on Instance uuid 6f6a8a33-e76e-450b-a94a-a0852fc6472c {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:39:48.106901 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b21c9002601480eaabdbcb74d337f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55c46d5c05b41adb823461813ee1e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:48.117576 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-22f53c7a-5da3-4854-9816-81cb69cb6502 tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 200 len: 1225 microversion: 2.1 time: 0.156183 Feb 28 10:39:48.118932 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 444/922] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:47 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:48.847483 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d3574401-8292-4321-9682-d9aadbb7a176 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:48.848195 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d3574401-8292-4321-9682-d9aadbb7a176 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:48.857720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d3574401-8292-4321-9682-d9aadbb7a176 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:48.858286 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d3574401-8292-4321-9682-d9aadbb7a176 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:48.859701 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d3574401-8292-4321-9682-d9aadbb7a176 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:48.860153 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d3574401-8292-4321-9682-d9aadbb7a176 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:48.873938 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-d3574401-8292-4321-9682-d9aadbb7a176 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] HTTP exception thrown: Instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 could not be found. Feb 28 10:39:48.875104 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d3574401-8292-4321-9682-d9aadbb7a176 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Returning 404 to user: Instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:39:48.875934 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d3574401-8292-4321-9682-d9aadbb7a176 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 404 len: 111 microversion: 2.1 time: 0.032610 Feb 28 10:39:48.876482 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 479/923] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:48 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:39:48.989011 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-572670323", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1951691794", "security_groups": [{"name": "tempest-secgroup-smoke-2034988073"}], "block_device_mapping_v2": [{"uuid": "0bdae82e-2b18-42fa-855c-7a68dd3d0113", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f54c5564-db90-44fd-8f80-426da1be843a"}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:49.112084 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] validate_networks() for [('f54c5564-db90-44fd-8f80-426da1be843a', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:39:49.135396 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0cd62e43-ba33-440b-831c-4bb8832d551f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:49.136002 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0cd62e43-ba33-440b-831c-4bb8832d551f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] [instance: 6f6a8a33-e76e-450b-a94a-a0852fc6472c] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:49.143131 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0cd62e43-ba33-440b-831c-4bb8832d551f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:49.143818 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0cd62e43-ba33-440b-831c-4bb8832d551f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:49.144611 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0cd62e43-ba33-440b-831c-4bb8832d551f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:49.145047 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0cd62e43-ba33-440b-831c-4bb8832d551f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:49.159169 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-0cd62e43-ba33-440b-831c-4bb8832d551f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] HTTP exception thrown: Instance 6f6a8a33-e76e-450b-a94a-a0852fc6472c could not be found. Feb 28 10:39:49.160012 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0cd62e43-ba33-440b-831c-4bb8832d551f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Returning 404 to user: Instance 6f6a8a33-e76e-450b-a94a-a0852fc6472c could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:39:49.161021 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0cd62e43-ba33-440b-831c-4bb8832d551f tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c" status: 404 len: 111 microversion: 2.1 time: 0.029497 Feb 28 10:39:49.161743 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 480/924] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:49 2022] GET /compute/v2.1/servers/6f6a8a33-e76e-450b-a94a-a0852fc6472c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 10:39:49.339358 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-c14d1779-8ccf-479e-952b-71db29fd35cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] Calling method '.version_select at 0x7f1c58194f70>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:49.372919 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-c14d1779-8ccf-479e-952b-71db29fd35cb tempest-TestShelveInstance-1817429595 tempest-TestShelveInstance-1817429595-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1600317973" status: 202 len: 0 microversion: 2.1 time: 0.036978 Feb 28 10:39:49.378544 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 481/925] 10.222.0.21 () {58 vars in 1253 bytes} [Mon Feb 28 10:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1600317973 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 28 10:39:49.545953 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:39:49.546625 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:39:49.547186 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:39:49.547671 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:39:49.548456 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:39:49.559476 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:49.560037 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:49.561182 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:49.562029 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:49.585997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:39:49.590066 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for user bcd74c3c272a427ba2e362c19cdbad8a and project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:39:49.654346 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:39:49.657442 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0bdae82e-2b18-42fa-855c-7a68dd3d0113',volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:39:49.810967 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-38ffc207-e66e-4f01-aaba-fc026f2df9ae tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.825850 Feb 28 10:39:49.812408 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 445/926] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:39:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:39:49.825172 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-28fcdb43-4fc7-4bea-a741-bf2e2d5904a1 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:49.826505 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-28fcdb43-4fc7-4bea-a741-bf2e2d5904a1 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:49.897680 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-28fcdb43-4fc7-4bea-a741-bf2e2d5904a1 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:49.908408 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-28fcdb43-4fc7-4bea-a741-bf2e2d5904a1 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1094 microversion: 2.1 time: 0.088303 Feb 28 10:39:49.910692 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 482/927] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:49 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:50.928024 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c2c32384-c77f-4b48-a657-e473a443ff62 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:50.928805 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c2c32384-c77f-4b48-a657-e473a443ff62 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:50.940496 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c2c32384-c77f-4b48-a657-e473a443ff62 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:50.941033 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c2c32384-c77f-4b48-a657-e473a443ff62 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:50.942899 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c2c32384-c77f-4b48-a657-e473a443ff62 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:50.944118 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c2c32384-c77f-4b48-a657-e473a443ff62 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:51.028017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c2c32384-c77f-4b48-a657-e473a443ff62 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:51.038698 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c2c32384-c77f-4b48-a657-e473a443ff62 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1200 microversion: 2.1 time: 0.117116 Feb 28 10:39:51.049591 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 446/928] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:50 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1200 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:52.057157 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-62198738-4713-4b8a-9075-6a65786db19a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:52.057776 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-62198738-4713-4b8a-9075-6a65786db19a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:52.070441 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62198738-4713-4b8a-9075-6a65786db19a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:52.071207 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62198738-4713-4b8a-9075-6a65786db19a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:52.072317 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62198738-4713-4b8a-9075-6a65786db19a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:52.075159 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-62198738-4713-4b8a-9075-6a65786db19a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:52.390625 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-62198738-4713-4b8a-9075-6a65786db19a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:52.403102 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-62198738-4713-4b8a-9075-6a65786db19a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1278 microversion: 2.1 time: 0.350106 Feb 28 10:39:52.405272 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 483/929] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:52 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1278 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:52.496172 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1955583103", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "networks": [{"uuid": "fef3d373-e45e-42e0-a9fe-a2bdbfebe47b"}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:52.571888 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] validate_networks() for [('fef3d373-e45e-42e0-a9fe-a2bdbfebe47b', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:39:53.437983 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-72a01b4e-e10f-4cfc-ac22-ac3cc147d18b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:53.439577 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-72a01b4e-e10f-4cfc-ac22-ac3cc147d18b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:53.461168 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72a01b4e-e10f-4cfc-ac22-ac3cc147d18b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:53.462040 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72a01b4e-e10f-4cfc-ac22-ac3cc147d18b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:53.464451 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72a01b4e-e10f-4cfc-ac22-ac3cc147d18b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:53.465151 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-72a01b4e-e10f-4cfc-ac22-ac3cc147d18b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:53.483722 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:39:53.486408 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:39:53.487211 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:39:53.487865 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:39:53.488569 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:39:53.518860 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:53.519843 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:53.521929 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:53.523941 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:53.582618 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Getting quotas for project 89ef7e55ea524b1c979f0dbad2a150df. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:39:53.593522 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Getting quotas for user d7520dc4fad24983a3ec9b1a205a3ef2 and project 89ef7e55ea524b1c979f0dbad2a150df. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:39:53.618077 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:39:53.620697 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:39:53.699192 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c62c565c-d093-4eae-9846-6f879e8f0670 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207829 Feb 28 10:39:53.700615 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 447/930] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:39:53.707151 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-25aaa9aa-c8fd-4cb1-a7d0-399566948c46 req-b8bb27c8-ac50-4d0f-a556-ad71cc6f4c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02502fae-f2b2-4e71-ae03-9a09632ee54a", "tag": "f274c160-69f7-45e0-bc4d-c8ced4b948b0"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:53.725147 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-25aaa9aa-c8fd-4cb1-a7d0-399566948c46 req-b8bb27c8-ac50-4d0f-a556-ad71cc6f4c82 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:53.726646 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-25aaa9aa-c8fd-4cb1-a7d0-399566948c46 req-b8bb27c8-ac50-4d0f-a556-ad71cc6f4c82 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:53.758266 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-25aaa9aa-c8fd-4cb1-a7d0-399566948c46 req-b8bb27c8-ac50-4d0f-a556-ad71cc6f4c82 service nova] Creating event network-changed:f274c160-69f7-45e0-bc4d-c8ced4b948b0 for instance 02502fae-f2b2-4e71-ae03-9a09632ee54a on hv-cinder-maste Feb 28 10:39:53.767453 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-25aaa9aa-c8fd-4cb1-a7d0-399566948c46 req-b8bb27c8-ac50-4d0f-a556-ad71cc6f4c82 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065351 Feb 28 10:39:53.771461 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 448/931] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:53.803986 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-fe84a946-98c0-479a-8515-c3a6aec2e8aa tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:53.808240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-fe84a946-98c0-479a-8515-c3a6aec2e8aa tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:53.901939 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-fe84a946-98c0-479a-8515-c3a6aec2e8aa tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:53.920547 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-fe84a946-98c0-479a-8515-c3a6aec2e8aa tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1219 microversion: 2.1 time: 0.130762 Feb 28 10:39:53.922015 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 449/932] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:53 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:53.985206 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-72a01b4e-e10f-4cfc-ac22-ac3cc147d18b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:53.996656 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-72a01b4e-e10f-4cfc-ac22-ac3cc147d18b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.578451 Feb 28 10:39:54.003275 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 484/933] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:53 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:54.938791 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c514c09b-1d48-4734-bf02-79a84ff824b9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:54.940769 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c514c09b-1d48-4734-bf02-79a84ff824b9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:54.956953 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c514c09b-1d48-4734-bf02-79a84ff824b9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:54.957700 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c514c09b-1d48-4734-bf02-79a84ff824b9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:54.958703 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c514c09b-1d48-4734-bf02-79a84ff824b9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:54.959299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c514c09b-1d48-4734-bf02-79a84ff824b9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:55.023631 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-df2397f5-7e81-4302-9835-c2ebb8467482 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:55.024317 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-df2397f5-7e81-4302-9835-c2ebb8467482 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:55.034136 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-df2397f5-7e81-4302-9835-c2ebb8467482 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:55.034874 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-df2397f5-7e81-4302-9835-c2ebb8467482 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:55.035998 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-df2397f5-7e81-4302-9835-c2ebb8467482 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:55.036643 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-df2397f5-7e81-4302-9835-c2ebb8467482 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:55.049261 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c514c09b-1d48-4734-bf02-79a84ff824b9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:55.058315 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c514c09b-1d48-4734-bf02-79a84ff824b9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1271 microversion: 2.1 time: 0.123761 Feb 28 10:39:55.058922 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 450/934] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:54 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:55.429382 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-df2397f5-7e81-4302-9835-c2ebb8467482 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:55.451079 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-df2397f5-7e81-4302-9835-c2ebb8467482 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.439138 Feb 28 10:39:55.455603 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 485/935] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:55 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:39:56.075675 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4e9dd2eb-05bf-4781-ad63-db38e22742d9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:56.076349 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4e9dd2eb-05bf-4781-ad63-db38e22742d9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:56.087686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4e9dd2eb-05bf-4781-ad63-db38e22742d9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:56.088149 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4e9dd2eb-05bf-4781-ad63-db38e22742d9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:56.088956 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4e9dd2eb-05bf-4781-ad63-db38e22742d9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:56.089395 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4e9dd2eb-05bf-4781-ad63-db38e22742d9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:56.476097 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-b09f751c-377e-4e62-9cdc-a2cf252898cc tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:56.477328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-b09f751c-377e-4e62-9cdc-a2cf252898cc tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:56.485659 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b09f751c-377e-4e62-9cdc-a2cf252898cc tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:56.486628 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b09f751c-377e-4e62-9cdc-a2cf252898cc tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:56.487758 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b09f751c-377e-4e62-9cdc-a2cf252898cc tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:56.489073 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-b09f751c-377e-4e62-9cdc-a2cf252898cc tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:56.731225 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4e9dd2eb-05bf-4781-ad63-db38e22742d9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:56.741725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4e9dd2eb-05bf-4781-ad63-db38e22742d9 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1319 microversion: 2.1 time: 0.669751 Feb 28 10:39:56.742802 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 451/936] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:56 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1319 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:56.749766 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-8859e2da-d722-4a7f-9fa3-303ffd8d6e26 req-b9a26926-ebaf-49f7-96ed-fc9893efee47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0571dfb-da57-47ac-b618-4dd1e205c187", "tag": "2570a898-72a1-43eb-8d29-021bd16e55cd"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:39:56.761021 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-8859e2da-d722-4a7f-9fa3-303ffd8d6e26 req-b9a26926-ebaf-49f7-96ed-fc9893efee47 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:56.762072 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-8859e2da-d722-4a7f-9fa3-303ffd8d6e26 req-b9a26926-ebaf-49f7-96ed-fc9893efee47 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:56.779959 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-8859e2da-d722-4a7f-9fa3-303ffd8d6e26 req-b9a26926-ebaf-49f7-96ed-fc9893efee47 service nova] Creating event network-changed:2570a898-72a1-43eb-8d29-021bd16e55cd for instance d0571dfb-da57-47ac-b618-4dd1e205c187 on hv-cinder-maste Feb 28 10:39:56.785707 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-8859e2da-d722-4a7f-9fa3-303ffd8d6e26 req-b9a26926-ebaf-49f7-96ed-fc9893efee47 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040805 Feb 28 10:39:56.786752 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 452/937] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:39:56.810584 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-b09f751c-377e-4e62-9cdc-a2cf252898cc tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:56.822844 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-b09f751c-377e-4e62-9cdc-a2cf252898cc tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.357021 Feb 28 10:39:56.824143 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 486/938] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:56 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:57.761573 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-14f9be15-2b5d-4583-af62-7a3e82bd9017 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:57.762211 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-14f9be15-2b5d-4583-af62-7a3e82bd9017 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:57.768522 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14f9be15-2b5d-4583-af62-7a3e82bd9017 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:57.768973 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14f9be15-2b5d-4583-af62-7a3e82bd9017 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:57.769766 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14f9be15-2b5d-4583-af62-7a3e82bd9017 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:57.770208 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-14f9be15-2b5d-4583-af62-7a3e82bd9017 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:57.840533 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-4cd1ff55-1677-42b2-85e5-35c62c32631c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:57.841471 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-4cd1ff55-1677-42b2-85e5-35c62c32631c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:57.851152 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4cd1ff55-1677-42b2-85e5-35c62c32631c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:57.851536 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4cd1ff55-1677-42b2-85e5-35c62c32631c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:57.852734 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4cd1ff55-1677-42b2-85e5-35c62c32631c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:57.853340 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-4cd1ff55-1677-42b2-85e5-35c62c32631c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:58.140948 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-14f9be15-2b5d-4583-af62-7a3e82bd9017 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:58.150796 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-14f9be15-2b5d-4583-af62-7a3e82bd9017 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1319 microversion: 2.1 time: 0.393904 Feb 28 10:39:58.152014 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 453/939] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:57 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:58.182048 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-4cd1ff55-1677-42b2-85e5-35c62c32631c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:58.190348 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-4cd1ff55-1677-42b2-85e5-35c62c32631c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.353811 Feb 28 10:39:58.190992 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 487/940] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:57 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:39:59.168978 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-cd157517-507d-453f-b7ff-4fbeb08d3c25 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:59.169667 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-cd157517-507d-453f-b7ff-4fbeb08d3c25 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:59.176828 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cd157517-507d-453f-b7ff-4fbeb08d3c25 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:59.177893 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cd157517-507d-453f-b7ff-4fbeb08d3c25 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:59.178922 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cd157517-507d-453f-b7ff-4fbeb08d3c25 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:59.179253 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cd157517-507d-453f-b7ff-4fbeb08d3c25 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:59.207447 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e4b2cc18-a201-49bb-9e70-403bcbe52356 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:39:59.208459 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e4b2cc18-a201-49bb-9e70-403bcbe52356 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:39:59.221826 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e4b2cc18-a201-49bb-9e70-403bcbe52356 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:59.222676 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e4b2cc18-a201-49bb-9e70-403bcbe52356 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:59.223703 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e4b2cc18-a201-49bb-9e70-403bcbe52356 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:39:59.224613 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e4b2cc18-a201-49bb-9e70-403bcbe52356 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:39:59.402155 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-cd157517-507d-453f-b7ff-4fbeb08d3c25 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:59.409884 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-cd157517-507d-453f-b7ff-4fbeb08d3c25 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1319 microversion: 2.1 time: 0.244876 Feb 28 10:39:59.410663 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 454/941] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:59 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:39:59.456224 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-e4b2cc18-a201-49bb-9e70-403bcbe52356 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:39:59.465970 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e4b2cc18-a201-49bb-9e70-403bcbe52356 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.262358 Feb 28 10:39:59.466992 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 488/942] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:39:59 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:00.427652 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ab5c3244-6d7a-4394-b01d-f90afe35ad33 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:00.428268 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ab5c3244-6d7a-4394-b01d-f90afe35ad33 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:00.435030 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ab5c3244-6d7a-4394-b01d-f90afe35ad33 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:00.435783 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ab5c3244-6d7a-4394-b01d-f90afe35ad33 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:00.437475 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ab5c3244-6d7a-4394-b01d-f90afe35ad33 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:00.438108 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ab5c3244-6d7a-4394-b01d-f90afe35ad33 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:00.483928 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-1cf1d463-4889-4677-b0c5-e6f1929a66da tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:00.484575 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-1cf1d463-4889-4677-b0c5-e6f1929a66da tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:00.491519 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1cf1d463-4889-4677-b0c5-e6f1929a66da tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:00.491972 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1cf1d463-4889-4677-b0c5-e6f1929a66da tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:00.492792 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1cf1d463-4889-4677-b0c5-e6f1929a66da tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:00.493229 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-1cf1d463-4889-4677-b0c5-e6f1929a66da tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:00.710486 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ab5c3244-6d7a-4394-b01d-f90afe35ad33 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:00.721351 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ab5c3244-6d7a-4394-b01d-f90afe35ad33 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1319 microversion: 2.1 time: 0.297628 Feb 28 10:40:00.722281 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 455/943] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:00 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:00.776687 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-1cf1d463-4889-4677-b0c5-e6f1929a66da tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:00.784767 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-1cf1d463-4889-4677-b0c5-e6f1929a66da tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.304854 Feb 28 10:40:00.785525 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 489/944] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:00 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:40:01.745428 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-4c83704a-a0b1-4383-a5bf-a7aa9955124b tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:01.746044 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-4c83704a-a0b1-4383-a5bf-a7aa9955124b tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:01.752962 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4c83704a-a0b1-4383-a5bf-a7aa9955124b tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:01.753420 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4c83704a-a0b1-4383-a5bf-a7aa9955124b tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:01.754419 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4c83704a-a0b1-4383-a5bf-a7aa9955124b tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:01.754888 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-4c83704a-a0b1-4383-a5bf-a7aa9955124b tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:01.801368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f01f583f-9567-4baf-8cf4-06037b4d47af tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:01.802587 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f01f583f-9567-4baf-8cf4-06037b4d47af tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:01.810436 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f01f583f-9567-4baf-8cf4-06037b4d47af tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:01.810919 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f01f583f-9567-4baf-8cf4-06037b4d47af tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:01.812265 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f01f583f-9567-4baf-8cf4-06037b4d47af tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:01.812709 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f01f583f-9567-4baf-8cf4-06037b4d47af tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:01.994696 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-4c83704a-a0b1-4383-a5bf-a7aa9955124b tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:02.005400 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-4c83704a-a0b1-4383-a5bf-a7aa9955124b tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1319 microversion: 2.1 time: 0.263673 Feb 28 10:40:02.006681 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 456/945] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:01 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:02.042725 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f01f583f-9567-4baf-8cf4-06037b4d47af tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:02.051876 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f01f583f-9567-4baf-8cf4-06037b4d47af tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.254310 Feb 28 10:40:02.062357 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 490/946] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:01 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:40:02.106990 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-1750cbb1-d565-43bd-adda-824fa7e2db50 req-d1e38eed-b069-42f0-accf-b0e18633b4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0571dfb-da57-47ac-b618-4dd1e205c187", "name": "network-vif-plugged", "status": "completed", "tag": "2570a898-72a1-43eb-8d29-021bd16e55cd"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:40:02.119612 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-1750cbb1-d565-43bd-adda-824fa7e2db50 req-d1e38eed-b069-42f0-accf-b0e18633b4a2 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:02.120464 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-1750cbb1-d565-43bd-adda-824fa7e2db50 req-d1e38eed-b069-42f0-accf-b0e18633b4a2 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:02.135022 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-1750cbb1-d565-43bd-adda-824fa7e2db50 req-d1e38eed-b069-42f0-accf-b0e18633b4a2 service nova] Creating event network-vif-plugged:2570a898-72a1-43eb-8d29-021bd16e55cd for instance d0571dfb-da57-47ac-b618-4dd1e205c187 on hv-cinder-maste Feb 28 10:40:02.141672 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-1750cbb1-d565-43bd-adda-824fa7e2db50 req-d1e38eed-b069-42f0-accf-b0e18633b4a2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038760 Feb 28 10:40:02.142277 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 457/947] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:40:03.023396 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-0dfb125a-7f19-4174-9476-8e4f8c9da231 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:03.024122 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-0dfb125a-7f19-4174-9476-8e4f8c9da231 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:03.030376 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0dfb125a-7f19-4174-9476-8e4f8c9da231 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:03.030938 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0dfb125a-7f19-4174-9476-8e4f8c9da231 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:03.031792 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0dfb125a-7f19-4174-9476-8e4f8c9da231 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:03.032301 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-0dfb125a-7f19-4174-9476-8e4f8c9da231 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:03.070038 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b8e77df3-54dd-4046-85ca-fc69e8cfee5c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:03.070798 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b8e77df3-54dd-4046-85ca-fc69e8cfee5c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:03.078525 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b8e77df3-54dd-4046-85ca-fc69e8cfee5c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:03.079019 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b8e77df3-54dd-4046-85ca-fc69e8cfee5c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:03.079827 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b8e77df3-54dd-4046-85ca-fc69e8cfee5c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:03.080292 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b8e77df3-54dd-4046-85ca-fc69e8cfee5c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:03.242286 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-b8e77df3-54dd-4046-85ca-fc69e8cfee5c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:03.252438 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b8e77df3-54dd-4046-85ca-fc69e8cfee5c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.187057 Feb 28 10:40:03.253101 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 458/948] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:03 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:40:03.341578 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-0dfb125a-7f19-4174-9476-8e4f8c9da231 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:03.348918 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-0dfb125a-7f19-4174-9476-8e4f8c9da231 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1319 microversion: 2.1 time: 0.329334 Feb 28 10:40:03.358617 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 491/949] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:03 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:04.154864 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-3def2232-3429-44ed-bf65-a833b64d5158 req-26002acf-2d19-4abd-b9d0-cf37e5e34463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02502fae-f2b2-4e71-ae03-9a09632ee54a", "name": "network-vif-plugged", "status": "completed", "tag": "f274c160-69f7-45e0-bc4d-c8ced4b948b0"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:40:04.164079 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-3def2232-3429-44ed-bf65-a833b64d5158 req-26002acf-2d19-4abd-b9d0-cf37e5e34463 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:04.164532 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-3def2232-3429-44ed-bf65-a833b64d5158 req-26002acf-2d19-4abd-b9d0-cf37e5e34463 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:04.175889 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-3def2232-3429-44ed-bf65-a833b64d5158 req-26002acf-2d19-4abd-b9d0-cf37e5e34463 service nova] Creating event network-vif-plugged:f274c160-69f7-45e0-bc4d-c8ced4b948b0 for instance 02502fae-f2b2-4e71-ae03-9a09632ee54a on hv-cinder-maste Feb 28 10:40:04.180684 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-3def2232-3429-44ed-bf65-a833b64d5158 req-26002acf-2d19-4abd-b9d0-cf37e5e34463 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029526 Feb 28 10:40:04.181254 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 459/950] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:40:04.270000 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8e2d66eb-0550-4667-b9e8-e8959d27903c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:04.270622 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8e2d66eb-0550-4667-b9e8-e8959d27903c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:04.276753 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8e2d66eb-0550-4667-b9e8-e8959d27903c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:04.277194 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8e2d66eb-0550-4667-b9e8-e8959d27903c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:04.277966 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8e2d66eb-0550-4667-b9e8-e8959d27903c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:04.278395 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8e2d66eb-0550-4667-b9e8-e8959d27903c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:04.367245 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-9e9f4eed-fe73-4964-9647-cb3814fdac72 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:04.368059 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-9e9f4eed-fe73-4964-9647-cb3814fdac72 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:04.375534 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9e9f4eed-fe73-4964-9647-cb3814fdac72 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:04.376086 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9e9f4eed-fe73-4964-9647-cb3814fdac72 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:04.376943 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9e9f4eed-fe73-4964-9647-cb3814fdac72 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:04.377472 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-9e9f4eed-fe73-4964-9647-cb3814fdac72 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:04.431688 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-8e2d66eb-0550-4667-b9e8-e8959d27903c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:04.442727 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8e2d66eb-0550-4667-b9e8-e8959d27903c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.176459 Feb 28 10:40:04.453564 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 492/951] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:04 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:04.533604 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-9e9f4eed-fe73-4964-9647-cb3814fdac72 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:04.541783 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-9e9f4eed-fe73-4964-9647-cb3814fdac72 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1507 microversion: 2.1 time: 0.179929 Feb 28 10:40:04.542353 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 460/952] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:04 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:40:05.459597 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2e8f33f6-cc63-4713-be31-eca1c44ab8de tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:05.460214 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2e8f33f6-cc63-4713-be31-eca1c44ab8de tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:05.466351 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e8f33f6-cc63-4713-be31-eca1c44ab8de tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:05.466839 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e8f33f6-cc63-4713-be31-eca1c44ab8de tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:05.467612 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e8f33f6-cc63-4713-be31-eca1c44ab8de tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:05.469121 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e8f33f6-cc63-4713-be31-eca1c44ab8de tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:05.605191 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-2e8f33f6-cc63-4713-be31-eca1c44ab8de tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:05.613248 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2e8f33f6-cc63-4713-be31-eca1c44ab8de tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.157501 Feb 28 10:40:05.613800 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 493/953] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:05 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:40:06.631725 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-ac361ccd-d0d3-4816-a166-402bd0ef5e09 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:06.632450 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-ac361ccd-d0d3-4816-a166-402bd0ef5e09 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:06.640186 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ac361ccd-d0d3-4816-a166-402bd0ef5e09 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:06.640645 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ac361ccd-d0d3-4816-a166-402bd0ef5e09 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:06.641715 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ac361ccd-d0d3-4816-a166-402bd0ef5e09 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:06.642331 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-ac361ccd-d0d3-4816-a166-402bd0ef5e09 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:06.776829 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-ac361ccd-d0d3-4816-a166-402bd0ef5e09 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:06.784671 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-ac361ccd-d0d3-4816-a166-402bd0ef5e09 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.158202 Feb 28 10:40:06.785230 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 461/954] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:06 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:07.805791 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-08bd014c-b26e-4386-ab89-682fb794b07c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:07.806524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-08bd014c-b26e-4386-ab89-682fb794b07c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:07.813337 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-08bd014c-b26e-4386-ab89-682fb794b07c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:07.813889 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-08bd014c-b26e-4386-ab89-682fb794b07c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:07.814808 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-08bd014c-b26e-4386-ab89-682fb794b07c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:07.815316 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-08bd014c-b26e-4386-ab89-682fb794b07c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:07.964522 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-08bd014c-b26e-4386-ab89-682fb794b07c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:07.973355 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-08bd014c-b26e-4386-ab89-682fb794b07c tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1266 microversion: 2.1 time: 0.174799 Feb 28 10:40:07.974511 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 494/955] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:07 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:08.992702 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e0cea32f-7410-45c5-938b-42dd161d3fe4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:08.993503 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e0cea32f-7410-45c5-938b-42dd161d3fe4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:08.999967 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e0cea32f-7410-45c5-938b-42dd161d3fe4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:09.000414 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e0cea32f-7410-45c5-938b-42dd161d3fe4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:09.001202 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e0cea32f-7410-45c5-938b-42dd161d3fe4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:09.001637 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e0cea32f-7410-45c5-938b-42dd161d3fe4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:09.139622 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e0cea32f-7410-45c5-938b-42dd161d3fe4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:09.149203 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e0cea32f-7410-45c5-938b-42dd161d3fe4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1452 microversion: 2.1 time: 0.160710 Feb 28 10:40:09.149779 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 462/956] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:08 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:09.164992 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5bfff861-d98a-41f2-a125-a5bb457867f7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:09.165609 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5bfff861-d98a-41f2-a125-a5bb457867f7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:09.172591 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5bfff861-d98a-41f2-a125-a5bb457867f7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:09.173124 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5bfff861-d98a-41f2-a125-a5bb457867f7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:09.173972 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5bfff861-d98a-41f2-a125-a5bb457867f7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:09.174410 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5bfff861-d98a-41f2-a125-a5bb457867f7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:09.314222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5bfff861-d98a-41f2-a125-a5bb457867f7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:09.321929 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5bfff861-d98a-41f2-a125-a5bb457867f7 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1452 microversion: 2.1 time: 0.160609 Feb 28 10:40:09.322493 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 495/957] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:09 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:40:11.504288 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-30799853-b7f4-4c50-a1bf-35856771a6e4 req-c0cc5b3d-fa31-49de-9360-118bec947b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02502fae-f2b2-4e71-ae03-9a09632ee54a", "tag": "f274c160-69f7-45e0-bc4d-c8ced4b948b0"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:40:11.515095 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-30799853-b7f4-4c50-a1bf-35856771a6e4 req-c0cc5b3d-fa31-49de-9360-118bec947b48 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:11.516093 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-30799853-b7f4-4c50-a1bf-35856771a6e4 req-c0cc5b3d-fa31-49de-9360-118bec947b48 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:11.528214 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-30799853-b7f4-4c50-a1bf-35856771a6e4 req-c0cc5b3d-fa31-49de-9360-118bec947b48 service nova] Creating event network-changed:f274c160-69f7-45e0-bc4d-c8ced4b948b0 for instance 02502fae-f2b2-4e71-ae03-9a09632ee54a on hv-cinder-maste Feb 28 10:40:11.534781 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-30799853-b7f4-4c50-a1bf-35856771a6e4 req-c0cc5b3d-fa31-49de-9360-118bec947b48 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034296 Feb 28 10:40:11.539947 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 463/958] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:40:21.744262 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-323b3426-0ce4-4072-99a3-925baa5f5217 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b5b1089-298e-4200-952f-5b3366dcb908", "device": "/dev/sdb"}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:40:21.746136 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-323b3426-0ce4-4072-99a3-925baa5f5217 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:21.753091 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-323b3426-0ce4-4072-99a3-925baa5f5217 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:21.753536 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-323b3426-0ce4-4072-99a3-925baa5f5217 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:21.754349 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-323b3426-0ce4-4072-99a3-925baa5f5217 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:21.754823 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-323b3426-0ce4-4072-99a3-925baa5f5217 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:21.996816 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-323b3426-0ce4-4072-99a3-925baa5f5217 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "POST /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256356 Feb 28 10:40:21.997439 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 496/959] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:40:21 2022] POST /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:40:42.540929 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-1c577e60-aea7-486a-b9a6-71bfb3230906 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:42.541511 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-1c577e60-aea7-486a-b9a6-71bfb3230906 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:42.548133 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1c577e60-aea7-486a-b9a6-71bfb3230906 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:42.548588 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1c577e60-aea7-486a-b9a6-71bfb3230906 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:42.549360 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1c577e60-aea7-486a-b9a6-71bfb3230906 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:42.549797 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-1c577e60-aea7-486a-b9a6-71bfb3230906 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:42.628760 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-1c577e60-aea7-486a-b9a6-71bfb3230906 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lazy-loading 'services' on Instance uuid d0571dfb-da57-47ac-b618-4dd1e205c187 {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:40:42.697106 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-1c577e60-aea7-486a-b9a6-71bfb3230906 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187/os-volume_attachments/0b5b1089-298e-4200-952f-5b3366dcb908" status: 202 len: 0 microversion: 2.1 time: 0.160866 Feb 28 10:40:42.697713 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 464/960] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:40:42 2022] DELETE /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187/os-volume_attachments/0b5b1089-298e-4200-952f-5b3366dcb908 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:40:43.811987 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-e6abee4e-136e-4408-b3a0-61e18326c305 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:43.812573 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e6abee4e-136e-4408-b3a0-61e18326c305 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:43.819524 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e6abee4e-136e-4408-b3a0-61e18326c305 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:43.819982 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e6abee4e-136e-4408-b3a0-61e18326c305 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:43.820774 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e6abee4e-136e-4408-b3a0-61e18326c305 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:43.821215 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-e6abee4e-136e-4408-b3a0-61e18326c305 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:43.859429 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-e6abee4e-136e-4408-b3a0-61e18326c305 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:40:43.960686 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-e6abee4e-136e-4408-b3a0-61e18326c305 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 204 len: 0 microversion: 2.1 time: 0.152400 Feb 28 10:40:43.961378 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 497/961] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:40:43 2022] DELETE /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:40:43.970858 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-be0a198f-2232-4d08-bae9-5bbb7c0771e0 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:43.971747 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-be0a198f-2232-4d08-bae9-5bbb7c0771e0 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:43.978805 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-be0a198f-2232-4d08-bae9-5bbb7c0771e0 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:43.979260 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-be0a198f-2232-4d08-bae9-5bbb7c0771e0 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:43.980051 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-be0a198f-2232-4d08-bae9-5bbb7c0771e0 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:43.980490 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-be0a198f-2232-4d08-bae9-5bbb7c0771e0 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:44.132811 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-be0a198f-2232-4d08-bae9-5bbb7c0771e0 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:44.140367 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-be0a198f-2232-4d08-bae9-5bbb7c0771e0 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1513 microversion: 2.1 time: 0.174298 Feb 28 10:40:44.140934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 465/962] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:43 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:40:45.163907 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f7b4d654-b7c9-45dd-a16b-27198c9be0b6 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:45.164595 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f7b4d654-b7c9-45dd-a16b-27198c9be0b6 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:45.170827 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f7b4d654-b7c9-45dd-a16b-27198c9be0b6 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:45.171275 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f7b4d654-b7c9-45dd-a16b-27198c9be0b6 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:45.172049 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f7b4d654-b7c9-45dd-a16b-27198c9be0b6 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:45.172580 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f7b4d654-b7c9-45dd-a16b-27198c9be0b6 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:45.307296 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f7b4d654-b7c9-45dd-a16b-27198c9be0b6 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:45.315189 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f7b4d654-b7c9-45dd-a16b-27198c9be0b6 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1513 microversion: 2.1 time: 0.155518 Feb 28 10:40:45.315744 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 498/963] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:45 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:46.145553 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-6da696cc-acfc-4ba4-af67-c3fc65e88b12 req-d42b6402-9952-4e65-979b-eb74bcc5d968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0571dfb-da57-47ac-b618-4dd1e205c187", "name": "network-vif-deleted", "tag": "2570a898-72a1-43eb-8d29-021bd16e55cd"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:40:46.154164 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-6da696cc-acfc-4ba4-af67-c3fc65e88b12 req-d42b6402-9952-4e65-979b-eb74bcc5d968 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:46.154629 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-6da696cc-acfc-4ba4-af67-c3fc65e88b12 req-d42b6402-9952-4e65-979b-eb74bcc5d968 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:46.322216 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-6da696cc-acfc-4ba4-af67-c3fc65e88b12 req-d42b6402-9952-4e65-979b-eb74bcc5d968 service nova] Creating event network-vif-deleted:2570a898-72a1-43eb-8d29-021bd16e55cd for instance d0571dfb-da57-47ac-b618-4dd1e205c187 on hv-cinder-maste Feb 28 10:40:46.327172 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-6da696cc-acfc-4ba4-af67-c3fc65e88b12 req-d42b6402-9952-4e65-979b-eb74bcc5d968 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185819 Feb 28 10:40:46.327789 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 466/964] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:40:46.332257 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:46.332865 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:46.339076 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:46.339522 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:46.340290 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:46.340723 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:46.370965 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:46.371402 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:46.372075 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lazy-loading 'fault' on Instance uuid d0571dfb-da57-47ac-b618-4dd1e205c187 {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:40:46.412449 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:46.419646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-21e6f3ba-b3bd-4314-9fdc-5f9de5440316 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 200 len: 1309 microversion: 2.1 time: 0.091361 Feb 28 10:40:46.420201 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 499/965] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:46 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:40:47.436686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2d1d5a23-ba8f-4b9d-ba35-e8751be92333 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:47.437300 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-2d1d5a23-ba8f-4b9d-ba35-e8751be92333 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d0571dfb-da57-47ac-b618-4dd1e205c187] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:47.443940 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d1d5a23-ba8f-4b9d-ba35-e8751be92333 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:47.444390 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d1d5a23-ba8f-4b9d-ba35-e8751be92333 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:47.445168 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d1d5a23-ba8f-4b9d-ba35-e8751be92333 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:47.445606 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-2d1d5a23-ba8f-4b9d-ba35-e8751be92333 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:47.458984 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-2d1d5a23-ba8f-4b9d-ba35-e8751be92333 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] HTTP exception thrown: Instance d0571dfb-da57-47ac-b618-4dd1e205c187 could not be found. Feb 28 10:40:47.459566 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-2d1d5a23-ba8f-4b9d-ba35-e8751be92333 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Returning 404 to user: Instance d0571dfb-da57-47ac-b618-4dd1e205c187 could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:40:47.460372 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-2d1d5a23-ba8f-4b9d-ba35-e8751be92333 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187" status: 404 len: 111 microversion: 2.1 time: 0.028469 Feb 28 10:40:47.460896 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 467/966] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:47 2022] GET /compute/v2.1/servers/d0571dfb-da57-47ac-b618-4dd1e205c187 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:40:55.222374 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-812529036", "imageRef": "c397f8e2-aa59-4c6a-b8d0-7da53ba7529f", "flavorRef": "452", "networks": [{"uuid": "fef3d373-e45e-42e0-a9fe-a2bdbfebe47b"}]}} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:40:55.274337 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.network.neutron [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] validate_networks() for [('fef3d373-e45e-42e0-a9fe-a2bdbfebe47b', None, None, None, None, None)] {{(pid=123152) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:40:55.607546 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Flavor limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:40:55.608011 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Image limits 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:40:55.608528 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Flavor pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:40:55.608935 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Image pref 0:0:0 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:40:55.609434 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.virt.hardware [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:40:55.619649 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:55.620093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:55.620896 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:55.621324 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:55.637085 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Getting quotas for project 89ef7e55ea524b1c979f0dbad2a150df. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:40:55.641332 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.quota [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Getting quotas for user d7520dc4fad24983a3ec9b1a205a3ef2 and project 89ef7e55ea524b1c979f0dbad2a150df. Resources: {'ram', 'cores', 'instances'} {{(pid=123152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:40:55.651756 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Going to run 1 instances... {{(pid=123152) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:40:55.653967 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c397f8e2-aa59-4c6a-b8d0-7da53ba7529f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:40:55.698046 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8a925d92-c41a-4221-a768-060c1877b623 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480122 Feb 28 10:40:55.698701 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 500/967] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:40:55.708771 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3e5b87f2-ab0a-416a-b556-c7c53097b0e2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:55.709478 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3e5b87f2-ab0a-416a-b556-c7c53097b0e2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:55.776934 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-3e5b87f2-ab0a-416a-b556-c7c53097b0e2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:55.784848 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3e5b87f2-ab0a-416a-b556-c7c53097b0e2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1218 microversion: 2.1 time: 0.079862 Feb 28 10:40:55.785407 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 468/968] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:55 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:56.802222 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ee4ccbca-040d-4b64-9fc8-8d4d4c4f30ef tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:56.803370 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ee4ccbca-040d-4b64-9fc8-8d4d4c4f30ef tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:56.809716 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ee4ccbca-040d-4b64-9fc8-8d4d4c4f30ef tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:56.810172 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ee4ccbca-040d-4b64-9fc8-8d4d4c4f30ef tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:56.810992 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ee4ccbca-040d-4b64-9fc8-8d4d4c4f30ef tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:56.812116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ee4ccbca-040d-4b64-9fc8-8d4d4c4f30ef tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:56.875876 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ee4ccbca-040d-4b64-9fc8-8d4d4c4f30ef tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:56.883412 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ee4ccbca-040d-4b64-9fc8-8d4d4c4f30ef tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1276 microversion: 2.1 time: 0.085768 Feb 28 10:40:56.883970 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 501/969] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:56 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:57.900667 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c5b1c5be-cc6c-4173-a207-5046f1fd270c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:57.901271 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-c5b1c5be-cc6c-4173-a207-5046f1fd270c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:57.908736 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c5b1c5be-cc6c-4173-a207-5046f1fd270c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:57.909180 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c5b1c5be-cc6c-4173-a207-5046f1fd270c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:57.910039 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c5b1c5be-cc6c-4173-a207-5046f1fd270c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:57.910538 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-c5b1c5be-cc6c-4173-a207-5046f1fd270c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:57.956669 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-7e5e8a58-89de-4a7f-953d-1f64cd621afb req-7e41c147-2246-4624-b9ac-2c95f3b18323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b", "tag": "63300a63-e5e8-46be-81e8-a3d84d573700"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:40:57.966506 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-7e5e8a58-89de-4a7f-953d-1f64cd621afb req-7e41c147-2246-4624-b9ac-2c95f3b18323 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:57.967109 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-7e5e8a58-89de-4a7f-953d-1f64cd621afb req-7e41c147-2246-4624-b9ac-2c95f3b18323 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:57.980806 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-7e5e8a58-89de-4a7f-953d-1f64cd621afb req-7e41c147-2246-4624-b9ac-2c95f3b18323 service nova] Creating event network-changed:63300a63-e5e8-46be-81e8-a3d84d573700 for instance d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b on hv-cinder-maste Feb 28 10:40:57.988540 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-7e5e8a58-89de-4a7f-953d-1f64cd621afb req-7e41c147-2246-4624-b9ac-2c95f3b18323 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037367 Feb 28 10:40:57.989954 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 502/970] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:40:58.051290 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-c5b1c5be-cc6c-4173-a207-5046f1fd270c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:58.058427 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c5b1c5be-cc6c-4173-a207-5046f1fd270c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1318 microversion: 2.1 time: 0.161657 Feb 28 10:40:58.059013 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 469/971] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:57 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:40:59.076698 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-750b193f-467a-4bb4-8248-465228f1aef2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:40:59.077298 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-750b193f-467a-4bb4-8248-465228f1aef2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:40:59.084564 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-750b193f-467a-4bb4-8248-465228f1aef2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:59.085006 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-750b193f-467a-4bb4-8248-465228f1aef2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:59.085785 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-750b193f-467a-4bb4-8248-465228f1aef2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:40:59.086214 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-750b193f-467a-4bb4-8248-465228f1aef2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:40:59.219328 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-750b193f-467a-4bb4-8248-465228f1aef2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:40:59.226951 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-750b193f-467a-4bb4-8248-465228f1aef2 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1318 microversion: 2.1 time: 0.154506 Feb 28 10:40:59.227506 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 503/972] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:40:59 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:41:00.243864 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-515ea040-8fc8-4965-b2fb-2502fd88d1e8 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:00.244480 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-515ea040-8fc8-4965-b2fb-2502fd88d1e8 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:00.251306 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-515ea040-8fc8-4965-b2fb-2502fd88d1e8 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:00.251748 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-515ea040-8fc8-4965-b2fb-2502fd88d1e8 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:00.252526 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-515ea040-8fc8-4965-b2fb-2502fd88d1e8 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:00.252959 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-515ea040-8fc8-4965-b2fb-2502fd88d1e8 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:00.389922 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-515ea040-8fc8-4965-b2fb-2502fd88d1e8 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:00.397348 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-515ea040-8fc8-4965-b2fb-2502fd88d1e8 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1318 microversion: 2.1 time: 0.157301 Feb 28 10:41:00.397916 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 470/973] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:00 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:41:01.414500 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-82df5db6-62b9-4181-bbdb-9d6622e612ca tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:01.415136 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-82df5db6-62b9-4181-bbdb-9d6622e612ca tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:01.421586 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82df5db6-62b9-4181-bbdb-9d6622e612ca tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:01.421858 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82df5db6-62b9-4181-bbdb-9d6622e612ca tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:01.422670 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82df5db6-62b9-4181-bbdb-9d6622e612ca tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:01.423108 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82df5db6-62b9-4181-bbdb-9d6622e612ca tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:01.553965 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-82df5db6-62b9-4181-bbdb-9d6622e612ca tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:01.561146 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-82df5db6-62b9-4181-bbdb-9d6622e612ca tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1318 microversion: 2.1 time: 0.150527 Feb 28 10:41:01.561700 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 504/974] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:01 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:41:02.518623 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-678f61e8-113f-42e7-ae31-5c80f950ba18 req-568a04b7-4d24-47ad-be51-972d62b21a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b", "name": "network-vif-plugged", "status": "completed", "tag": "63300a63-e5e8-46be-81e8-a3d84d573700"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:41:02.526892 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-678f61e8-113f-42e7-ae31-5c80f950ba18 req-568a04b7-4d24-47ad-be51-972d62b21a36 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:02.527341 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-678f61e8-113f-42e7-ae31-5c80f950ba18 req-568a04b7-4d24-47ad-be51-972d62b21a36 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:02.539305 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-678f61e8-113f-42e7-ae31-5c80f950ba18 req-568a04b7-4d24-47ad-be51-972d62b21a36 service nova] Creating event network-vif-plugged:63300a63-e5e8-46be-81e8-a3d84d573700 for instance d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b on hv-cinder-maste Feb 28 10:41:02.544207 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-678f61e8-113f-42e7-ae31-5c80f950ba18 req-568a04b7-4d24-47ad-be51-972d62b21a36 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029326 Feb 28 10:41:02.544838 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 471/975] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:41:02.577274 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9eee56a8-56a7-4575-adc0-8663a609c64a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:02.578349 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9eee56a8-56a7-4575-adc0-8663a609c64a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:02.584364 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9eee56a8-56a7-4575-adc0-8663a609c64a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:02.584823 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9eee56a8-56a7-4575-adc0-8663a609c64a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:02.585616 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9eee56a8-56a7-4575-adc0-8663a609c64a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:02.586052 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9eee56a8-56a7-4575-adc0-8663a609c64a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:02.731173 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9eee56a8-56a7-4575-adc0-8663a609c64a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:02.738995 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9eee56a8-56a7-4575-adc0-8663a609c64a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1318 microversion: 2.1 time: 0.165508 Feb 28 10:41:02.739561 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 505/976] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:02 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:41:03.757425 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-26c5ad32-ed11-49fe-b85b-461fbc690e27 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:03.758182 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-26c5ad32-ed11-49fe-b85b-461fbc690e27 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:03.764262 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26c5ad32-ed11-49fe-b85b-461fbc690e27 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:03.764710 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26c5ad32-ed11-49fe-b85b-461fbc690e27 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:03.765536 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26c5ad32-ed11-49fe-b85b-461fbc690e27 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:03.765968 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-26c5ad32-ed11-49fe-b85b-461fbc690e27 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:03.905252 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-26c5ad32-ed11-49fe-b85b-461fbc690e27 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:03.913356 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-26c5ad32-ed11-49fe-b85b-461fbc690e27 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1318 microversion: 2.1 time: 0.160619 Feb 28 10:41:03.913924 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 472/977] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:03 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:41:04.930891 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f496adf7-07cf-4ef3-8b4d-74922c8159b1 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:04.931422 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f496adf7-07cf-4ef3-8b4d-74922c8159b1 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:04.938534 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f496adf7-07cf-4ef3-8b4d-74922c8159b1 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:04.939008 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f496adf7-07cf-4ef3-8b4d-74922c8159b1 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:04.939825 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f496adf7-07cf-4ef3-8b4d-74922c8159b1 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:04.940261 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f496adf7-07cf-4ef3-8b4d-74922c8159b1 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:05.072881 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-f496adf7-07cf-4ef3-8b4d-74922c8159b1 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:05.080298 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f496adf7-07cf-4ef3-8b4d-74922c8159b1 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1505 microversion: 2.1 time: 0.153598 Feb 28 10:41:05.080850 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 506/978] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:04 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:41:05.096513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-3cb6b074-dc97-43e5-8edb-2aef0e83b27f tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9604ab1-a4e7-431d-84b3-438c8b29913a", "device": "/dev/sdb"}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:41:05.098115 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-3cb6b074-dc97-43e5-8edb-2aef0e83b27f tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:05.104567 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3cb6b074-dc97-43e5-8edb-2aef0e83b27f tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:05.105017 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3cb6b074-dc97-43e5-8edb-2aef0e83b27f tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:05.105786 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3cb6b074-dc97-43e5-8edb-2aef0e83b27f tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:05.106243 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-3cb6b074-dc97-43e5-8edb-2aef0e83b27f tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:05.349513 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-3cb6b074-dc97-43e5-8edb-2aef0e83b27f tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "POST /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256790 Feb 28 10:41:05.350368 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 473/979] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 10:41:05 2022] POST /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:41:23.559148 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5c3e7388-4256-4796-bfcb-312449bb210a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:23.559648 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5c3e7388-4256-4796-bfcb-312449bb210a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:23.567388 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5c3e7388-4256-4796-bfcb-312449bb210a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:23.567835 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5c3e7388-4256-4796-bfcb-312449bb210a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:23.568614 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5c3e7388-4256-4796-bfcb-312449bb210a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:23.569193 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5c3e7388-4256-4796-bfcb-312449bb210a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:23.651954 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.objects.instance [None req-5c3e7388-4256-4796-bfcb-312449bb210a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lazy-loading 'services' on Instance uuid d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b {{(pid=123152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:41:23.726040 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5c3e7388-4256-4796-bfcb-312449bb210a tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b/os-volume_attachments/c9604ab1-a4e7-431d-84b3-438c8b29913a" status: 202 len: 0 microversion: 2.1 time: 0.170755 Feb 28 10:41:23.727736 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 507/980] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 10:41:23 2022] DELETE /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b/os-volume_attachments/c9604ab1-a4e7-431d-84b3-438c8b29913a => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:41:24.853075 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a3d684e4-e7ba-44c6-8188-352788c80e80 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:24.853736 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a3d684e4-e7ba-44c6-8188-352788c80e80 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:24.861910 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a3d684e4-e7ba-44c6-8188-352788c80e80 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:24.862368 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a3d684e4-e7ba-44c6-8188-352788c80e80 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:24.863267 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a3d684e4-e7ba-44c6-8188-352788c80e80 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:24.863709 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a3d684e4-e7ba-44c6-8188-352788c80e80 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:24.889819 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a3d684e4-e7ba-44c6-8188-352788c80e80 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Going to try to terminate instance {{(pid=123151) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:41:24.965578 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a3d684e4-e7ba-44c6-8188-352788c80e80 tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 204 len: 0 microversion: 2.1 time: 0.116462 Feb 28 10:41:24.966178 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 474/981] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:41:24 2022] DELETE /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:41:24.976099 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-86b0c095-0ec4-49bf-a889-14f40063ad3d tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:24.976808 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-86b0c095-0ec4-49bf-a889-14f40063ad3d tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:24.984085 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-86b0c095-0ec4-49bf-a889-14f40063ad3d tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:24.984544 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-86b0c095-0ec4-49bf-a889-14f40063ad3d tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:24.985378 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-86b0c095-0ec4-49bf-a889-14f40063ad3d tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:24.985811 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-86b0c095-0ec4-49bf-a889-14f40063ad3d tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:25.128200 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-86b0c095-0ec4-49bf-a889-14f40063ad3d tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:25.135589 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-86b0c095-0ec4-49bf-a889-14f40063ad3d tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1511 microversion: 2.1 time: 0.164301 Feb 28 10:41:25.136145 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 508/982] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:24 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:41:26.155134 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-bd580d7d-028c-47e4-9ab8-70ed6561f5cb tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:26.155699 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-bd580d7d-028c-47e4-9ab8-70ed6561f5cb tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:26.162788 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bd580d7d-028c-47e4-9ab8-70ed6561f5cb tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:26.163258 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bd580d7d-028c-47e4-9ab8-70ed6561f5cb tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:26.164331 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bd580d7d-028c-47e4-9ab8-70ed6561f5cb tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:26.164730 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-bd580d7d-028c-47e4-9ab8-70ed6561f5cb tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:26.321928 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-bd580d7d-028c-47e4-9ab8-70ed6561f5cb tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:26.329289 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-bd580d7d-028c-47e4-9ab8-70ed6561f5cb tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1511 microversion: 2.1 time: 0.178986 Feb 28 10:41:26.329858 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 475/983] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:26 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:41:27.190275 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-0b8c6746-c5b0-4fad-8429-d2e1d7b6cf88 req-bafad394-d062-49c3-88bd-61ff71201d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b", "name": "network-vif-deleted", "tag": "63300a63-e5e8-46be-81e8-a3d84d573700"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:41:27.199868 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-0b8c6746-c5b0-4fad-8429-d2e1d7b6cf88 req-bafad394-d062-49c3-88bd-61ff71201d72 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:27.200314 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-0b8c6746-c5b0-4fad-8429-d2e1d7b6cf88 req-bafad394-d062-49c3-88bd-61ff71201d72 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:27.212870 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-0b8c6746-c5b0-4fad-8429-d2e1d7b6cf88 req-bafad394-d062-49c3-88bd-61ff71201d72 service nova] Creating event network-vif-deleted:63300a63-e5e8-46be-81e8-a3d84d573700 for instance d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b on hv-cinder-maste Feb 28 10:41:27.220361 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-0b8c6746-c5b0-4fad-8429-d2e1d7b6cf88 req-bafad394-d062-49c3-88bd-61ff71201d72 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033633 Feb 28 10:41:27.220970 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 509/984] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:41:27.347207 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:27.347802 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:27.354299 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:27.354789 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:27.355571 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:27.356003 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:27.385673 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:27.386120 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:27.386568 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.objects.instance [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lazy-loading 'fault' on Instance uuid d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b {{(pid=123151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 28 10:41:27.430154 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7520dc4fad24983a3ec9b1a205a3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ef7e55ea524b1c979f0dbad2a150df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:27.437868 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-a66bc8de-f038-4c0e-b9b3-22ab9a7ee17e tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 200 len: 1308 microversion: 2.1 time: 0.094586 Feb 28 10:41:27.438428 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 476/985] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:27 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:41:28.455375 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8d605271-739e-4b5f-a95f-502c717cea9c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:28.456075 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-8d605271-739e-4b5f-a95f-502c717cea9c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] [instance: d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:28.462511 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8d605271-739e-4b5f-a95f-502c717cea9c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:28.462989 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8d605271-739e-4b5f-a95f-502c717cea9c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:28.463767 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8d605271-739e-4b5f-a95f-502c717cea9c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:28.464205 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-8d605271-739e-4b5f-a95f-502c717cea9c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:28.478743 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-8d605271-739e-4b5f-a95f-502c717cea9c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] HTTP exception thrown: Instance d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b could not be found. Feb 28 10:41:28.479324 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-8d605271-739e-4b5f-a95f-502c717cea9c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] Returning 404 to user: Instance d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:41:28.480126 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-8d605271-739e-4b5f-a95f-502c717cea9c tempest-VolumesSnapshotTestJSON-97011663 tempest-VolumesSnapshotTestJSON-97011663-project] 10.222.0.21 "GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b" status: 404 len: 111 microversion: 2.1 time: 0.029083 Feb 28 10:41:28.480640 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 510/986] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:28 2022] GET /compute/v2.1/servers/d9d9fb77-5d2d-415d-a3c6-a9dfcff87b7b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:41:47.199427 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:41:47.199980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: Mon Feb 28 10:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 10:41:53.482277 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:41:53.482939 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: Mon Feb 28 10:41:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 10:41:57.436910 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1255579746", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1951691794", "security_groups": [{"name": "tempest-secgroup-smoke-2034988073"}], "block_device_mapping_v2": [{"uuid": "7d60f47b-eea0-4545-97d4-0303eb85f46f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f54c5564-db90-44fd-8f80-426da1be843a"}]}} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:41:57.650470 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.network.neutron [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] validate_networks() for [('f54c5564-db90-44fd-8f80-426da1be843a', None, None, None, None, None)] {{(pid=123151) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Feb 28 10:41:58.021926 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Flavor limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 10:41:58.022352 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Image limits 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 10:41:58.022852 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Flavor pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 10:41:58.023261 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Image pref 0:0:0 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 10:41:58.023673 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.virt.hardware [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 10:41:58.032669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:58.033108 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:58.033914 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:58.034345 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:58.051233 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Feb 28 10:41:58.054996 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.quota [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Getting quotas for user bcd74c3c272a427ba2e362c19cdbad8a and project 340c3f500cc14200bce6eb3ae5d77f21. Resources: {'ram', 'cores', 'instances'} {{(pid=123151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Feb 28 10:41:58.110191 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Going to run 1 instances... {{(pid=123151) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Feb 28 10:41:58.112423 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d60f47b-eea0-4545-97d4-0303eb85f46f',volume_size=None,volume_type=None)] {{(pid=123151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Feb 28 10:41:58.236301 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-b51780da-1d00-45e9-bf22-3f23546389a5 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.803490 Feb 28 10:41:58.236945 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 477/987] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 10:41:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 10:41:58.247999 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9de73cbb-02b3-4f27-9fa4-bf59c3387eb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:58.248642 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9de73cbb-02b3-4f27-9fa4-bf59c3387eb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:58.400287 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9de73cbb-02b3-4f27-9fa4-bf59c3387eb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:58.407587 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9de73cbb-02b3-4f27-9fa4-bf59c3387eb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1095 microversion: 2.1 time: 0.164572 Feb 28 10:41:58.408164 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 511/988] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:58 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1095 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:41:59.425625 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-908fd904-4fe7-4c13-b5ff-a8e29f137edf tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:41:59.426240 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-908fd904-4fe7-4c13-b5ff-a8e29f137edf tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:41:59.432697 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-908fd904-4fe7-4c13-b5ff-a8e29f137edf tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:59.433142 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-908fd904-4fe7-4c13-b5ff-a8e29f137edf tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:59.434441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-908fd904-4fe7-4c13-b5ff-a8e29f137edf tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:41:59.434900 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-908fd904-4fe7-4c13-b5ff-a8e29f137edf tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:41:59.494970 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-908fd904-4fe7-4c13-b5ff-a8e29f137edf tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:41:59.503283 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-908fd904-4fe7-4c13-b5ff-a8e29f137edf tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1211 microversion: 2.1 time: 0.082015 Feb 28 10:41:59.503845 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 478/989] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:41:59 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:00.521719 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-563b69ae-17b9-4370-9278-278975370263 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:00.522342 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-563b69ae-17b9-4370-9278-278975370263 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:00.528781 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-563b69ae-17b9-4370-9278-278975370263 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:00.529236 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-563b69ae-17b9-4370-9278-278975370263 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:00.530033 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-563b69ae-17b9-4370-9278-278975370263 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:00.530477 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-563b69ae-17b9-4370-9278-278975370263 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:00.678106 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-563b69ae-17b9-4370-9278-278975370263 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:00.685818 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-563b69ae-17b9-4370-9278-278975370263 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.168045 Feb 28 10:42:00.686391 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 512/990] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:00 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:00.795362 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-7a0d1d17-2793-4c6d-8688-31cffcd8f269 req-c16f74d0-8b20-43a6-9434-4417869a854a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124cc7bf-a6e8-41a1-99a4-64b03570ee1e", "tag": "e654cf94-dbbc-4064-aa4e-f52927060522"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:42:00.806152 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-7a0d1d17-2793-4c6d-8688-31cffcd8f269 req-c16f74d0-8b20-43a6-9434-4417869a854a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:00.806653 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-7a0d1d17-2793-4c6d-8688-31cffcd8f269 req-c16f74d0-8b20-43a6-9434-4417869a854a service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:00.823333 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-7a0d1d17-2793-4c6d-8688-31cffcd8f269 req-c16f74d0-8b20-43a6-9434-4417869a854a service nova] Creating event network-changed:e654cf94-dbbc-4064-aa4e-f52927060522 for instance 124cc7bf-a6e8-41a1-99a4-64b03570ee1e on hv-cinder-maste Feb 28 10:42:00.832694 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-7a0d1d17-2793-4c6d-8688-31cffcd8f269 req-c16f74d0-8b20-43a6-9434-4417869a854a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042036 Feb 28 10:42:00.833278 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 479/991] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:42:01.703706 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-56691470-0277-468f-a0cd-d6e871e7e477 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:01.704368 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-56691470-0277-468f-a0cd-d6e871e7e477 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:01.710528 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-56691470-0277-468f-a0cd-d6e871e7e477 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:01.711018 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-56691470-0277-468f-a0cd-d6e871e7e477 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:01.711793 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-56691470-0277-468f-a0cd-d6e871e7e477 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:01.712221 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-56691470-0277-468f-a0cd-d6e871e7e477 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:01.854639 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-56691470-0277-468f-a0cd-d6e871e7e477 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:01.862710 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-56691470-0277-468f-a0cd-d6e871e7e477 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.163370 Feb 28 10:42:01.863269 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 513/992] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:01 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:02.880297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-6f4e1f89-0164-4ca1-bdac-6fe4691badad tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:02.881000 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-6f4e1f89-0164-4ca1-bdac-6fe4691badad tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:02.887999 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6f4e1f89-0164-4ca1-bdac-6fe4691badad tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:02.888448 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6f4e1f89-0164-4ca1-bdac-6fe4691badad tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:02.889223 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6f4e1f89-0164-4ca1-bdac-6fe4691badad tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:02.889657 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-6f4e1f89-0164-4ca1-bdac-6fe4691badad tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:03.022395 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-6f4e1f89-0164-4ca1-bdac-6fe4691badad tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:03.029906 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-6f4e1f89-0164-4ca1-bdac-6fe4691badad tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.154016 Feb 28 10:42:03.030464 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 480/993] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:02 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:04.046961 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-70807f55-5e98-4d61-884c-6c7997379da0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:04.047573 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-70807f55-5e98-4d61-884c-6c7997379da0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:04.053996 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-70807f55-5e98-4d61-884c-6c7997379da0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:04.054498 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-70807f55-5e98-4d61-884c-6c7997379da0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:04.055432 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-70807f55-5e98-4d61-884c-6c7997379da0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:04.055871 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-70807f55-5e98-4d61-884c-6c7997379da0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:04.191096 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-70807f55-5e98-4d61-884c-6c7997379da0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:04.202908 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-70807f55-5e98-4d61-884c-6c7997379da0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.160119 Feb 28 10:42:04.203464 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 514/994] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:04 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:05.220803 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-74e91fc8-75b1-48e8-9673-879abe5290ea tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:05.221411 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-74e91fc8-75b1-48e8-9673-879abe5290ea tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:05.228418 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74e91fc8-75b1-48e8-9673-879abe5290ea tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:05.228883 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74e91fc8-75b1-48e8-9673-879abe5290ea tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:05.229675 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74e91fc8-75b1-48e8-9673-879abe5290ea tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:05.230118 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-74e91fc8-75b1-48e8-9673-879abe5290ea tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:05.363704 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-74e91fc8-75b1-48e8-9673-879abe5290ea tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:05.372018 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-74e91fc8-75b1-48e8-9673-879abe5290ea tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.154240 Feb 28 10:42:05.372446 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 481/995] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:05 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:06.389663 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-d4f032e1-ff94-4f7d-b118-4ea97c4dafe9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:06.390284 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-d4f032e1-ff94-4f7d-b118-4ea97c4dafe9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:06.396561 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d4f032e1-ff94-4f7d-b118-4ea97c4dafe9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:06.397009 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d4f032e1-ff94-4f7d-b118-4ea97c4dafe9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:06.397838 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d4f032e1-ff94-4f7d-b118-4ea97c4dafe9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:06.398220 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-d4f032e1-ff94-4f7d-b118-4ea97c4dafe9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:06.529640 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-d4f032e1-ff94-4f7d-b118-4ea97c4dafe9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:06.536871 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-d4f032e1-ff94-4f7d-b118-4ea97c4dafe9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.152133 Feb 28 10:42:06.537424 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 515/996] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:06 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:07.552793 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-504a9502-6423-4d52-93be-62e9d6f592bb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:07.553413 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-504a9502-6423-4d52-93be-62e9d6f592bb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:07.560618 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-504a9502-6423-4d52-93be-62e9d6f592bb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:07.561070 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-504a9502-6423-4d52-93be-62e9d6f592bb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:07.561854 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-504a9502-6423-4d52-93be-62e9d6f592bb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:07.562297 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-504a9502-6423-4d52-93be-62e9d6f592bb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:07.702629 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-504a9502-6423-4d52-93be-62e9d6f592bb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:07.709837 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-504a9502-6423-4d52-93be-62e9d6f592bb tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.161027 Feb 28 10:42:07.710398 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 482/997] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:07 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:08.727970 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-6e1195d1-4f78-4fc4-bf8c-10ad2bf0d7a8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:08.728585 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-6e1195d1-4f78-4fc4-bf8c-10ad2bf0d7a8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:08.734920 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e1195d1-4f78-4fc4-bf8c-10ad2bf0d7a8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:08.735371 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e1195d1-4f78-4fc4-bf8c-10ad2bf0d7a8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:08.736153 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e1195d1-4f78-4fc4-bf8c-10ad2bf0d7a8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:08.736587 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-6e1195d1-4f78-4fc4-bf8c-10ad2bf0d7a8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:08.873965 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-6e1195d1-4f78-4fc4-bf8c-10ad2bf0d7a8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:08.881289 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-6e1195d1-4f78-4fc4-bf8c-10ad2bf0d7a8 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.157161 Feb 28 10:42:08.881819 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 516/998] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:08 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:09.898559 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-081d49ce-c720-4c51-8303-aecd4b7b0b16 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:09.899196 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-081d49ce-c720-4c51-8303-aecd4b7b0b16 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:09.905642 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-081d49ce-c720-4c51-8303-aecd4b7b0b16 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:09.906091 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-081d49ce-c720-4c51-8303-aecd4b7b0b16 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:09.906913 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-081d49ce-c720-4c51-8303-aecd4b7b0b16 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:09.907356 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-081d49ce-c720-4c51-8303-aecd4b7b0b16 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:10.043392 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-081d49ce-c720-4c51-8303-aecd4b7b0b16 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:10.050669 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-081d49ce-c720-4c51-8303-aecd4b7b0b16 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.155939 Feb 28 10:42:10.051256 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 483/999] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:09 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:10.959233 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-128c8979-20bb-4424-8777-9c236c963662 req-8e255d2e-8c19-47df-86c7-ddd94ab3f4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124cc7bf-a6e8-41a1-99a4-64b03570ee1e", "name": "network-vif-plugged", "status": "completed", "tag": "e654cf94-dbbc-4064-aa4e-f52927060522"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:42:10.969306 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-128c8979-20bb-4424-8777-9c236c963662 req-8e255d2e-8c19-47df-86c7-ddd94ab3f4a5 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:10.969898 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-128c8979-20bb-4424-8777-9c236c963662 req-8e255d2e-8c19-47df-86c7-ddd94ab3f4a5 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:10.984166 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-128c8979-20bb-4424-8777-9c236c963662 req-8e255d2e-8c19-47df-86c7-ddd94ab3f4a5 service nova] Creating event network-vif-plugged:e654cf94-dbbc-4064-aa4e-f52927060522 for instance 124cc7bf-a6e8-41a1-99a4-64b03570ee1e on hv-cinder-maste Feb 28 10:42:10.989544 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-128c8979-20bb-4424-8777-9c236c963662 req-8e255d2e-8c19-47df-86c7-ddd94ab3f4a5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034070 Feb 28 10:42:10.990367 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 517/1000] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:42:11.067648 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-8f206201-fc64-4adf-bd64-04f937453778 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:11.068269 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-8f206201-fc64-4adf-bd64-04f937453778 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:11.074537 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8f206201-fc64-4adf-bd64-04f937453778 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:11.075022 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8f206201-fc64-4adf-bd64-04f937453778 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:11.075810 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8f206201-fc64-4adf-bd64-04f937453778 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:11.076249 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-8f206201-fc64-4adf-bd64-04f937453778 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:11.212344 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-8f206201-fc64-4adf-bd64-04f937453778 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:11.220971 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-8f206201-fc64-4adf-bd64-04f937453778 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.157319 Feb 28 10:42:11.221445 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 484/1001] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:11 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:42:12.237878 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-9c470269-3467-4a60-8dd8-db707f14adb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:12.238491 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-9c470269-3467-4a60-8dd8-db707f14adb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:12.244927 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c470269-3467-4a60-8dd8-db707f14adb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:12.245373 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c470269-3467-4a60-8dd8-db707f14adb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:12.246254 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c470269-3467-4a60-8dd8-db707f14adb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:12.246715 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-9c470269-3467-4a60-8dd8-db707f14adb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:12.391861 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-9c470269-3467-4a60-8dd8-db707f14adb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:12.399237 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-9c470269-3467-4a60-8dd8-db707f14adb9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1267 microversion: 2.1 time: 0.165735 Feb 28 10:42:12.399787 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 518/1002] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:12 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:13.416713 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-e8b52692-4be6-4893-8263-a440744b26d9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:13.417820 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-e8b52692-4be6-4893-8263-a440744b26d9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:13.424215 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e8b52692-4be6-4893-8263-a440744b26d9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:13.424662 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e8b52692-4be6-4893-8263-a440744b26d9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:13.425441 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e8b52692-4be6-4893-8263-a440744b26d9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:13.425876 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-e8b52692-4be6-4893-8263-a440744b26d9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:13.557088 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-e8b52692-4be6-4893-8263-a440744b26d9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:13.567549 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-e8b52692-4be6-4893-8263-a440744b26d9 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1454 microversion: 2.1 time: 0.154770 Feb 28 10:42:13.568113 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 485/1003] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:13 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:13.583389 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5042b00d-be6d-4b10-8b6f-a37e5b70fc50 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:42:13.584000 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5042b00d-be6d-4b10-8b6f-a37e5b70fc50 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:42:13.590837 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5042b00d-be6d-4b10-8b6f-a37e5b70fc50 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:13.591285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5042b00d-be6d-4b10-8b6f-a37e5b70fc50 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:13.592059 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5042b00d-be6d-4b10-8b6f-a37e5b70fc50 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:13.592502 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5042b00d-be6d-4b10-8b6f-a37e5b70fc50 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:13.725111 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5042b00d-be6d-4b10-8b6f-a37e5b70fc50 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:42:13.733256 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5042b00d-be6d-4b10-8b6f-a37e5b70fc50 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1454 microversion: 2.1 time: 0.153611 Feb 28 10:42:13.733822 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 519/1004] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:42:13 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:42:15.337030 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-eac4c790-ecaa-41d0-9c38-3e2f256144e8 req-a3053ae7-5265-481f-b62c-18f3a4d6f01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124cc7bf-a6e8-41a1-99a4-64b03570ee1e", "tag": "e654cf94-dbbc-4064-aa4e-f52927060522"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:42:15.346980 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-eac4c790-ecaa-41d0-9c38-3e2f256144e8 req-a3053ae7-5265-481f-b62c-18f3a4d6f01d service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:42:15.347417 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-eac4c790-ecaa-41d0-9c38-3e2f256144e8 req-a3053ae7-5265-481f-b62c-18f3a4d6f01d service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:42:15.360546 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-eac4c790-ecaa-41d0-9c38-3e2f256144e8 req-a3053ae7-5265-481f-b62c-18f3a4d6f01d service nova] Creating event network-changed:e654cf94-dbbc-4064-aa4e-f52927060522 for instance 124cc7bf-a6e8-41a1-99a4-64b03570ee1e on hv-cinder-maste Feb 28 10:42:15.366950 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-eac4c790-ecaa-41d0-9c38-3e2f256144e8 req-a3053ae7-5265-481f-b62c-18f3a4d6f01d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033486 Feb 28 10:42:15.367538 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 486/1005] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:43:44.346080 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bbb4c3b6-8dcc-4c70-8c85-9957b6728f4b] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 28 10:43:44.350093 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2dc9db84-3781-41b9-b783-0611b8f7399a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:44.350620 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2dc9db84-3781-41b9-b783-0611b8f7399a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:44.357276 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2dc9db84-3781-41b9-b783-0611b8f7399a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:44.358628 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2dc9db84-3781-41b9-b783-0611b8f7399a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:44.359646 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2dc9db84-3781-41b9-b783-0611b8f7399a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:44.360088 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2dc9db84-3781-41b9-b783-0611b8f7399a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:44.387647 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2dc9db84-3781-41b9-b783-0611b8f7399a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Going to try to terminate instance {{(pid=123152) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:43:44.413739 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [req-e33ab0e6-6111-489e-b5bc-7a17afe957f3 req-d536bf19-fd08-4962-860a-4ff7c7f7376e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124cc7bf-a6e8-41a1-99a4-64b03570ee1e", "tag": "e654cf94-dbbc-4064-aa4e-f52927060522"}]} {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:43:44.424480 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-e33ab0e6-6111-489e-b5bc-7a17afe957f3 req-d536bf19-fd08-4962-860a-4ff7c7f7376e service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:44.425324 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [req-e33ab0e6-6111-489e-b5bc-7a17afe957f3 req-d536bf19-fd08-4962-860a-4ff7c7f7376e service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:44.437644 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.compute.server_external_events [req-e33ab0e6-6111-489e-b5bc-7a17afe957f3 req-d536bf19-fd08-4962-860a-4ff7c7f7376e service nova] Creating event network-changed:e654cf94-dbbc-4064-aa4e-f52927060522 for instance 124cc7bf-a6e8-41a1-99a4-64b03570ee1e on hv-cinder-maste Feb 28 10:43:44.443935 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [req-e33ab0e6-6111-489e-b5bc-7a17afe957f3 req-d536bf19-fd08-4962-860a-4ff7c7f7376e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097825 Feb 28 10:43:44.446868 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 487/1006] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:43:44.468372 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2dc9db84-3781-41b9-b783-0611b8f7399a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "DELETE /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 204 len: 0 microversion: 2.1 time: 0.124171 Feb 28 10:43:44.468961 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 520/1007] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:43:44 2022] DELETE /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:43:44.478130 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-68a0f6ae-3e46-4e79-87a0-dd70b2e9d3ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:44.479532 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-68a0f6ae-3e46-4e79-87a0-dd70b2e9d3ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:44.486509 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-68a0f6ae-3e46-4e79-87a0-dd70b2e9d3ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:44.486997 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-68a0f6ae-3e46-4e79-87a0-dd70b2e9d3ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:44.487791 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-68a0f6ae-3e46-4e79-87a0-dd70b2e9d3ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:44.488260 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-68a0f6ae-3e46-4e79-87a0-dd70b2e9d3ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:44.644336 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-68a0f6ae-3e46-4e79-87a0-dd70b2e9d3ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:43:44.651735 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-68a0f6ae-3e46-4e79-87a0-dd70b2e9d3ec tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1579 microversion: 2.1 time: 0.177865 Feb 28 10:43:44.652296 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 488/1008] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:43:44 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 10:43:45.669674 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-5f92b395-80a0-4272-808f-db851da6263a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:45.671064 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-5f92b395-80a0-4272-808f-db851da6263a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:45.678851 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5f92b395-80a0-4272-808f-db851da6263a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:45.679308 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5f92b395-80a0-4272-808f-db851da6263a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:45.680096 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5f92b395-80a0-4272-808f-db851da6263a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:45.680548 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-5f92b395-80a0-4272-808f-db851da6263a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:45.685511 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO oslo.messaging._drivers.impl_rabbit [-] [bbb4c3b6-8dcc-4c70-8c85-9957b6728f4b] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 59424. Feb 28 10:43:45.815735 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-5f92b395-80a0-4272-808f-db851da6263a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:43:45.823065 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-5f92b395-80a0-4272-808f-db851da6263a tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1460 microversion: 2.1 time: 0.157789 Feb 28 10:43:45.823827 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 521/1009] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:43:45 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1460 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:43:46.839844 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-f9293e7d-895a-4b23-92b7-e80cd723e896 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:46.840458 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-f9293e7d-895a-4b23-92b7-e80cd723e896 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:46.848767 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9293e7d-895a-4b23-92b7-e80cd723e896 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:46.849584 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9293e7d-895a-4b23-92b7-e80cd723e896 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:46.850577 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9293e7d-895a-4b23-92b7-e80cd723e896 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:46.851201 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-f9293e7d-895a-4b23-92b7-e80cd723e896 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:46.877266 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-e3adb635-78ed-4e8d-8daa-8bf4ec1dd5da req-b486aca3-f386-4be3-92e2-3e75fa84fe0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124cc7bf-a6e8-41a1-99a4-64b03570ee1e", "name": "network-vif-deleted", "tag": "e654cf94-dbbc-4064-aa4e-f52927060522"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:43:46.890621 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-e3adb635-78ed-4e8d-8daa-8bf4ec1dd5da req-b486aca3-f386-4be3-92e2-3e75fa84fe0c service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:46.891133 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-e3adb635-78ed-4e8d-8daa-8bf4ec1dd5da req-b486aca3-f386-4be3-92e2-3e75fa84fe0c service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:46.905205 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-e3adb635-78ed-4e8d-8daa-8bf4ec1dd5da req-b486aca3-f386-4be3-92e2-3e75fa84fe0c service nova] Creating event network-vif-deleted:e654cf94-dbbc-4064-aa4e-f52927060522 for instance 124cc7bf-a6e8-41a1-99a4-64b03570ee1e on hv-cinder-maste Feb 28 10:43:46.914889 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-e3adb635-78ed-4e8d-8daa-8bf4ec1dd5da req-b486aca3-f386-4be3-92e2-3e75fa84fe0c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042113 Feb 28 10:43:46.916411 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 522/1010] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 10:43:46.923686 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-f9293e7d-895a-4b23-92b7-e80cd723e896 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:43:46.932041 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-f9293e7d-895a-4b23-92b7-e80cd723e896 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 200 len: 1392 microversion: 2.1 time: 0.096125 Feb 28 10:43:46.932607 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 489/1011] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:43:46 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 1392 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:43:47.949317 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-82cbff57-24a6-402a-ac7a-0aa3b41a8130 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:47.949949 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-82cbff57-24a6-402a-ac7a-0aa3b41a8130 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 124cc7bf-a6e8-41a1-99a4-64b03570ee1e] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:47.957569 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82cbff57-24a6-402a-ac7a-0aa3b41a8130 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:47.958012 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82cbff57-24a6-402a-ac7a-0aa3b41a8130 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:47.958933 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82cbff57-24a6-402a-ac7a-0aa3b41a8130 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:47.959382 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-82cbff57-24a6-402a-ac7a-0aa3b41a8130 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:47.973863 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-82cbff57-24a6-402a-ac7a-0aa3b41a8130 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] HTTP exception thrown: Instance 124cc7bf-a6e8-41a1-99a4-64b03570ee1e could not be found. Feb 28 10:43:47.974444 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-82cbff57-24a6-402a-ac7a-0aa3b41a8130 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Returning 404 to user: Instance 124cc7bf-a6e8-41a1-99a4-64b03570ee1e could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:43:47.975277 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-82cbff57-24a6-402a-ac7a-0aa3b41a8130 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e" status: 404 len: 111 microversion: 2.1 time: 0.030338 Feb 28 10:43:47.975794 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 523/1012] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:43:47 2022] GET /compute/v2.1/servers/124cc7bf-a6e8-41a1-99a4-64b03570ee1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 10:43:51.033350 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-0401b219-ebdb-40a2-9ced-72ca705eee48 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:51.033869 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0401b219-ebdb-40a2-9ced-72ca705eee48 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:51.036958 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-e489c757-1edd-4ea2-9915-eaf979c323ba req-e597ce5e-07b8-438f-87cd-f5a8876039f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02502fae-f2b2-4e71-ae03-9a09632ee54a", "tag": "f274c160-69f7-45e0-bc4d-c8ced4b948b0"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:43:51.040565 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0401b219-ebdb-40a2-9ced-72ca705eee48 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:51.041023 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0401b219-ebdb-40a2-9ced-72ca705eee48 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:51.041815 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0401b219-ebdb-40a2-9ced-72ca705eee48 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:51.042249 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-0401b219-ebdb-40a2-9ced-72ca705eee48 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:51.046102 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-e489c757-1edd-4ea2-9915-eaf979c323ba req-e597ce5e-07b8-438f-87cd-f5a8876039f2 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:51.046692 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-e489c757-1edd-4ea2-9915-eaf979c323ba req-e597ce5e-07b8-438f-87cd-f5a8876039f2 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:51.058059 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-e489c757-1edd-4ea2-9915-eaf979c323ba req-e597ce5e-07b8-438f-87cd-f5a8876039f2 service nova] Creating event network-changed:f274c160-69f7-45e0-bc4d-c8ced4b948b0 for instance 02502fae-f2b2-4e71-ae03-9a09632ee54a on hv-cinder-maste Feb 28 10:43:51.064161 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-e489c757-1edd-4ea2-9915-eaf979c323ba req-e597ce5e-07b8-438f-87cd-f5a8876039f2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031878 Feb 28 10:43:51.065163 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 524/1013] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:43:51.069031 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-0401b219-ebdb-40a2-9ced-72ca705eee48 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Going to try to terminate instance {{(pid=123151) delete /opt/stack/nova/nova/compute/api.py:2664}} Feb 28 10:43:51.150440 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-0401b219-ebdb-40a2-9ced-72ca705eee48 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "DELETE /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 204 len: 0 microversion: 2.1 time: 0.121439 Feb 28 10:43:51.155384 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 490/1014] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:43:51 2022] DELETE /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 10:43:51.162285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-ddf58ac5-1963-42dc-b59c-aeef14aab5d0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:51.163285 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-ddf58ac5-1963-42dc-b59c-aeef14aab5d0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:51.170775 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ddf58ac5-1963-42dc-b59c-aeef14aab5d0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:51.171229 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ddf58ac5-1963-42dc-b59c-aeef14aab5d0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:51.172086 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ddf58ac5-1963-42dc-b59c-aeef14aab5d0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:51.172525 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-ddf58ac5-1963-42dc-b59c-aeef14aab5d0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:51.319593 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.policy [None req-ddf58ac5-1963-42dc-b59c-aeef14aab5d0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123152) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:43:51.328390 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-ddf58ac5-1963-42dc-b59c-aeef14aab5d0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1575 microversion: 2.1 time: 0.171056 Feb 28 10:43:51.329028 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 525/1015] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:43:51 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:43:52.348014 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-264d6327-9e62-48cf-95a9-e50c00c40453 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:52.348728 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-264d6327-9e62-48cf-95a9-e50c00c40453 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:52.354921 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-264d6327-9e62-48cf-95a9-e50c00c40453 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:52.355402 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-264d6327-9e62-48cf-95a9-e50c00c40453 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:52.356192 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-264d6327-9e62-48cf-95a9-e50c00c40453 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:52.356677 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-264d6327-9e62-48cf-95a9-e50c00c40453 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:52.493364 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-264d6327-9e62-48cf-95a9-e50c00c40453 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:43:52.501666 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-264d6327-9e62-48cf-95a9-e50c00c40453 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1458 microversion: 2.1 time: 0.158456 Feb 28 10:43:52.502305 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 491/1016] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:43:52 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:43:53.279919 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [req-366eb343-124f-4ab4-abe7-7271f67f5c38 req-da61a193-a2ce-4795-9e24-12ece4812761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02502fae-f2b2-4e71-ae03-9a09632ee54a", "name": "network-vif-deleted", "tag": "f274c160-69f7-45e0-bc4d-c8ced4b948b0"}]} {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 10:43:53.289089 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-366eb343-124f-4ab4-abe7-7271f67f5c38 req-da61a193-a2ce-4795-9e24-12ece4812761 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:53.289537 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [req-366eb343-124f-4ab4-abe7-7271f67f5c38 req-da61a193-a2ce-4795-9e24-12ece4812761 service nova] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:53.301463 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.compute.server_external_events [req-366eb343-124f-4ab4-abe7-7271f67f5c38 req-da61a193-a2ce-4795-9e24-12ece4812761 service nova] Creating event network-vif-deleted:f274c160-69f7-45e0-bc4d-c8ced4b948b0 for instance 02502fae-f2b2-4e71-ae03-9a09632ee54a on hv-cinder-maste Feb 28 10:43:53.306179 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [req-366eb343-124f-4ab4-abe7-7271f67f5c38 req-da61a193-a2ce-4795-9e24-12ece4812761 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030484 Feb 28 10:43:53.306735 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 526/1017] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 10:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 10:43:53.518668 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-08683e92-6a07-4658-94a9-82b27c67509d tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:53.519211 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-08683e92-6a07-4658-94a9-82b27c67509d tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:53.525405 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-08683e92-6a07-4658-94a9-82b27c67509d tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:53.525852 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-08683e92-6a07-4658-94a9-82b27c67509d tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:53.526662 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-08683e92-6a07-4658-94a9-82b27c67509d tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:53.527107 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-08683e92-6a07-4658-94a9-82b27c67509d tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:53.592797 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.policy [None req-08683e92-6a07-4658-94a9-82b27c67509d tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd74c3c272a427ba2e362c19cdbad8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340c3f500cc14200bce6eb3ae5d77f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123151) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 10:43:53.601810 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-08683e92-6a07-4658-94a9-82b27c67509d tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 200 len: 1225 microversion: 2.1 time: 0.087665 Feb 28 10:43:53.602420 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 492/1018] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:43:53 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 10:43:54.620768 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2e3f879b-d702-4b48-af80-5f160dd135c4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:54.621488 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-2e3f879b-d702-4b48-af80-5f160dd135c4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 02502fae-f2b2-4e71-ae03-9a09632ee54a] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:54.628299 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e3f879b-d702-4b48-af80-5f160dd135c4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:54.628742 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e3f879b-d702-4b48-af80-5f160dd135c4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:54.629512 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e3f879b-d702-4b48-af80-5f160dd135c4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:54.629941 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-2e3f879b-d702-4b48-af80-5f160dd135c4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:54.643186 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-2e3f879b-d702-4b48-af80-5f160dd135c4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] HTTP exception thrown: Instance 02502fae-f2b2-4e71-ae03-9a09632ee54a could not be found. Feb 28 10:43:54.643776 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-2e3f879b-d702-4b48-af80-5f160dd135c4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Returning 404 to user: Instance 02502fae-f2b2-4e71-ae03-9a09632ee54a could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:43:54.644589 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-2e3f879b-d702-4b48-af80-5f160dd135c4 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a" status: 404 len: 111 microversion: 2.1 time: 0.028477 Feb 28 10:43:54.645116 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 527/1019] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:43:54 2022] GET /compute/v2.1/servers/02502fae-f2b2-4e71-ae03-9a09632ee54a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:43:55.083330 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-cc708098-a0ba-4dbe-8d2c-f6df21438178 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:55.083844 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.compute.api [None req-cc708098-a0ba-4dbe-8d2c-f6df21438178 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123151) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:55.090265 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cc708098-a0ba-4dbe-8d2c-f6df21438178 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:55.090759 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cc708098-a0ba-4dbe-8d2c-f6df21438178 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:55.091549 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cc708098-a0ba-4dbe-8d2c-f6df21438178 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:55.091990 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG oslo_concurrency.lockutils [None req-cc708098-a0ba-4dbe-8d2c-f6df21438178 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:55.108078 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.wsgi [None req-cc708098-a0ba-4dbe-8d2c-f6df21438178 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] HTTP exception thrown: Instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 could not be found. Feb 28 10:43:55.108667 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-cc708098-a0ba-4dbe-8d2c-f6df21438178 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Returning 404 to user: Instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 could not be found. {{(pid=123151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:43:55.109744 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-cc708098-a0ba-4dbe-8d2c-f6df21438178 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 404 len: 111 microversion: 2.1 time: 0.030317 Feb 28 10:43:55.110025 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 493/1020] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 10:43:55 2022] DELETE /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:43:55.118184 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f1982b87-9d2c-4ba7-9795-e1274ad2ba8b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '>' {{(pid=123152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:55.118846 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.compute.api [None req-f1982b87-9d2c-4ba7-9795-e1274ad2ba8b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] [instance: 8b1357a1-2e5f-4972-91cc-f16f95ebeb23] Fetching instance by UUID {{(pid=123152) get /opt/stack/nova/nova/compute/api.py:2918}} Feb 28 10:43:55.124644 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f1982b87-9d2c-4ba7-9795-e1274ad2ba8b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:55.125196 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f1982b87-9d2c-4ba7-9795-e1274ad2ba8b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:55.125921 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f1982b87-9d2c-4ba7-9795-e1274ad2ba8b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 28 10:43:55.126356 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG oslo_concurrency.lockutils [None req-f1982b87-9d2c-4ba7-9795-e1274ad2ba8b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Lock "c755071f-4a59-4a8e-8ef6-dfe2026d3c30" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 28 10:43:55.139117 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.wsgi [None req-f1982b87-9d2c-4ba7-9795-e1274ad2ba8b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] HTTP exception thrown: Instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 could not be found. Feb 28 10:43:55.139686 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: DEBUG nova.api.openstack.wsgi [None req-f1982b87-9d2c-4ba7-9795-e1274ad2ba8b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Returning 404 to user: Instance 8b1357a1-2e5f-4972-91cc-f16f95ebeb23 could not be found. {{(pid=123152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 28 10:43:55.141008 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO nova.api.openstack.requestlog [None req-f1982b87-9d2c-4ba7-9795-e1274ad2ba8b tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23" status: 404 len: 111 microversion: 2.1 time: 0.026183 Feb 28 10:43:55.141720 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: [pid: 123152|app: 0|req: 528/1021] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 10:43:55 2022] GET /compute/v2.1/servers/8b1357a1-2e5f-4972-91cc-f16f95ebeb23 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 10:43:56.419457 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: DEBUG nova.api.openstack.wsgi [None req-c6e8116d-3294-4a42-a24d-473a296187b0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] Calling method '.version_select at 0x7f1c5816a670>' {{(pid=123151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 10:43:56.443486 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO nova.api.openstack.requestlog [None req-c6e8116d-3294-4a42-a24d-473a296187b0 tempest-TestVolumeBootPattern-1459461157 tempest-TestVolumeBootPattern-1459461157-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1951691794" status: 202 len: 0 microversion: 2.1 time: 0.027924 Feb 28 10:43:56.447694 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: [pid: 123151|app: 0|req: 494/1022] 10.222.0.21 () {58 vars in 1262 bytes} [Mon Feb 28 10:43:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1951691794 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 10:45:13.490354 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:45:13.491017 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: Mon Feb 28 10:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 10:45:13.646480 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:45:13.646984 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: Mon Feb 28 10:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 10:46:38.799242 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:46:38.799852 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: Mon Feb 28 10:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 10:46:47.212060 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:46:47.212560 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: Mon Feb 28 10:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 10:46:58.992012 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:46:58.992474 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: Mon Feb 28 10:46:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 10:47:01.793397 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:47:01.793967 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: Mon Feb 28 10:47:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 10:48:33.498968 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:48:33.499658 dv-cinder-master-3-iscsi devstack@n-api.service[123152]: Mon Feb 28 10:48:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 10:48:33.654369 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 10:48:33.654886 dv-cinder-master-3-iscsi devstack@n-api.service[123151]: Mon Feb 28 10:48:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!